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APPENDIX I ■ 

RESEARCH EFFORTS AND FINDINGS 
% 

In this appendix we identify ongoing research efforts relevant 
to compensatory education generally and to this study specifically. 



GENERAL COMPENSATORY EDUCATION RESEARCH EFFORTS/FINDINGS 

Many recent studies of compensatory education have found 
that specific factors contribute significantly to the success 
of compensatory education programs* Although the thrust of these 
studies was not toward the specific question of individualization 
these research efforts and ^ some of their ' findings provide a 
useful perspective prior to focusing on this specific effort. 
Purposes 

Most of the studies conducted in the 1960s (e.g., TEMPO, 
1968^; Glass, 1970^; and Gordon, . 1971^ ; AIR, 1968"^) focused on 
compens^atory education programs funded under such specific 
titles as ESEA Title I and ESEA Title III. Generally the 
results of these studies concentrated on educational results and, 
to a lesser extent, program purposes. The findings in such 
studies indicated: 



m that existing evaluations (by LEAs and SEAs) of programs 
were inade.quate-; 

• that few school program characteristics (as opposed 
^ to socio-economic status variables) were associated 

with student achievement; and ^ 

*• that many types of compensatory education programs 
had no't been successful w 

The most i;ecent major attempt to describe the characteristics 

of compensatory education programs on a national basis is in the 

initial phases of the ongoing Education Testing .Service General 

Reading Study related to the possible effects of compensatory 

education programs on the development of reading skills. Data 

from the survey (presented in 1973) indicated that there were 

substantial variations among schools in the ways in which they 

approached' compensatory education reading programs. For the most 

part, however, the purposes of the LEA programs were taken to be 

those stated in their reports — not necessarily verified. through 

additional studies of the perception of individuals' involved in 

the programs. In 1973, the Planar Corporation completed a 

study^ which attempted to compile, and synthesize ±he results of 

Title I math anQ reading programs.' A supplementary Planar 

study^ , focusing on the administration of Title I programs, 

required some descriptive information on program characteristics 

and purposes. These studies did, however, have some major 

limitations , including: 

• the lack of a taxonomy to be used for further synthesis; 

• the dependence on stated objectives, as opposed to 
those verified on site; and 

^ • the lack of a survey of the perceptions of SEA and 
LEA officials regarding program purposes.^ 



LEA Planning and Coordination 

The nature and extent of planning and coordination activities 
varies greatly among the types of compensatory education programs 
{e.g., in formula-based programs where' program planning is weak; 
in special projects such as Title I.II^ where heavy emphasis is 
placed on needs assessment) • Coordination, •'a very elusive term, 
is frequently used as^ a catch-all category of inadequacy explaining 
apparent program failure. Recent studies conducted by TURNKEY 
(San Antonio Independent School District, 1973'^; and Fairfax 
County, Virginia, 1974'') indicate that coordination has very 
different meanings to different staff within the same compensatory 
education programs. 

Planning, which occurs at the LEA level, often is influenced 
by SEA guidelines and procedures which in turn a.re influenced by 
Federal requirements for specific types of compensatory education 
programs (e.g.. Title I funds-can now be used for, planning 
purposes) • In many states, SEA administered prpgrams impose few 
requirements beyond Federal guidelines • In others, SEAs require 
strict adherence to rigorous planning and needs assessment 
procedures. As the Planar study ^ implies, the context of SEA 
procedures has an important impact on both compensatory, education 
program results and the degree of individualization of such 
programs. ' , * 

Unlike other sectors of our society where the effectiveness 
of planning and coo-rdination can be measured by some eventual 
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"bottom linfe", in education it is particularly difficult to 
attribute planning effects on student performance because program 
implementation is extremely "people-linked" • The results of 
turnkey's Study of Michigan's Compensatory E-ducation Programs''"^ 
and similar studies (e.g., Wirt, 1975''''''; Klepak, New York State 
Governor's Office, 1974 ) indicate that involvement of staff m 
planning and initial decision-making are clearly and positively 
associated with program effectiveness. 
School/Program Characteristics 

During the final stages of the . Fleischman Commission 

Study , Gutherie summarized the results of nineteen ma30i: 

stvidies on school characteristics/ef fects(^As a result, he was 

able to identify four categories of variables which relate 

significantly to student performance measures. These categories 

are summarized below: 

Schctol Facilities: school site size 

building age 

/ percent of makeshift classrooms 

• Instructional Materials: library volumes per student 

supply of textbooks 

• Teacher Characteristics : verbal ability 

experience. ^ 
job satisfaction 

• Student Environment: school size (enrollment) 

classrooms ^per 1,000 students 
. percent of students transferring 

Many of these factors, w^ich were identified as significant, are 

subject to relatively little or only indirect influence by Federal 

policy. 



A more recent synthesis of studies on educational effective- 

» 

ness was conducted txy Heim and Perl^^. This research reviewed • 
and analyzed the findings of over 100 stiii^ies most of which f5>cused 
on compensatory education. Using reading and math test scores a^ 
dependent variables, the study identified contributing factors, 
including: 

• determinants jiot amenable to policy control (e.g., SES, 
district size, location) ; 

• staff-related inputs (e.g., teaching experience, 
class size) ; 

• pedagodfy-related variables (e.g., independent study, 
TV, programmed learning) . 

>- 

The findings of the study indicated certain program operating 
characteristics which were 'systematically related to student 
reading achievement at both the early and late elementary levels. 
Specifically, it found that SES, race, and rural background were 
related to achievement/ that class size and teacher dfegree status 
were sigjiif icantly related, while teacher experience was not; 
and that certain pedagogical techniques and'^strategies had mixed 
effec*ts-on reading achievement at^he elementary level. 

r In 1972, the Office' of the Assistant Secretary for Planning 
and Evaluation, ^HEW^^, attempted to summarize evidence of 
compensatory education effectiveness. After duly noting the 
difficulty in summarizing studies which use different measures 
of student achievement (including tests of different reliabilities 
and validities) the study concluded that compensatory educatioa 



programs can be made to "work" and "tnat an effective compensatory 
education program will indeed require significant additional 
resources and we have recommended as an approximation of that 
addition the figure of $300 (per stud.ent)," The major limitations 
of this summary were the very short time available to conduct the 
summary and heavy reliance upon annual reports submitted by SEAs 
and evaluation reports of individual projects. 

RELATED ^RESEARCH EFFORTS ON INDIVIDUALIZED INSTRUCyiON 

While the'se studies have been directed toward policy and 
research issues related to compensatory education generally, a 
number of studies conduc'ied in phe recent pas^t have attempted to 
focus upon various aspects of individualized instruction. Below 
^ we have summarized the relevant portions of this research, the 
issues addressed, and some of the .problems eifcountered as they 
rei'ate to this particular study. . ' 

In 1973, USOE's Division of Compensatory Education conducted ' 
a synthesis of six major studies related to compensatory education 
These studies included: , 

# ; Strategies of Compensation ; A Review of Educational 

Projects for the Disadvantaged in the United States 
(Organization for Economic Cooperation and Development, 
1971). 

# Compensatory Education : Evaluation in Perspective 

' - (Edmund W. Gordon, Information Retrieval Center on the 
Disadvantaged, 1970) . 

# How Effective Is Sct^fopling? A Critical Review and 
Synthes;Ls of Research Findings (Final Report td the 
President's ConuniWion on School Finance, Rand 
Corporation, 1971). • 



. • ESEA Title I ; A J^eanalysis and Synthesis of Evaluation 
Data from Fiscal Year 1965 through 1970 (American ^ 
Institutes for Research, 1972). ' ' , 

• Draft, Final Report, Exemplary Projects Studies 

• (Columbia University, 1972), 

• State Title I Evaluation Reports for FY 1972, 

In ^n attempt "to identify cqmrnon characteristrcs of effective 

programs, USOE identified several characteristics of individualized 

16 

programs of instruction. As summarized in the NSPRA Report , 

tHese characteristics included: ' ^ ' 

"Clear objectives which .must be clearly written' and 
stated in specific measurable terms; instructiohal 
techniques and materials must <:losely relate to those 

• objectives . " ^ ' ' 1 . 

• ^ "Attention to individiial needs which includes a 'cjareful 

diagnosis and individual plan for each student" . > ^ - 

• "Flexibility and grouping which allow staff opportunities 
to provide small group instruction and to teach 
frequently on a one-to-one basis. USOE notes that when ^ 
group instruction was part of the daily program it 
tended ^to be more effective if stucjents were not 
confined to the same group for more than several days 
without reassessment of the teacher's and students* 
strengths . " ^ 

• "Personnel management which allows key staff personnel 
to work individually with teachers in the classroom. 
USPE stresses the need for much coordination and 
cooperation among sta^ff and a well designed inservice 
program. " 

• "Structured progipam approach which stresses sequential 
order and activity. Pupils must also receive frequent 
ind immediate feedback. 

As this RFP notes, individualized techniques have consistently 

been identified by researchers as characteristics of successful 

programs which teach basic skills. In the case studies of Wargo 
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and *others involved in some of the previously mentioned studies, 

these* characteristics were, for the most part, found to occur in 

special projects which were established in a more cdstly an<J closely 

controlled ^environment than normally maintained in schools. Hence, . 

accepting the general premise that individualized instruction 

is relatively more effective in special . pro jects funded .under^ 

certain conditions, the need exists to examine the degree, to 

which individualized instruction can be accomplisheci in regular 

cJ.assrooms and the way in which it can^ best be introduced. While 

fev; previous research efforts ,have attempted to answer this 

specific question on a large-scale, several recent efforts have 

.been and are being, designed* to e:iamin« many facets of this 

specific issue. . - u ... 

Recently, the Feder^al Reserve^ Bank of Philadelphia conducted 
17/* 

a study of learning efficiency and equity in the Philadelphia 
Public 'Schools . The. two researchers, Dfs. Anita Suiraners and 
Barbara Wolfe, in developing an input/output model for assessing' 
resources *and effectiveness, attempted to identify the types of 
resources and resource mixes which appeared to be most successful 
with various categories of students grouped by grade level , ^ race 
and other factors. Although the research effort did not include 
a^ comparison of individualized vs. standardized instruction, the 
characteristics of programs which appear to contr>yCite to high 
achievement for various categories of studehts in many instances 
did represent many of the characteristics associated with 
.individualized programs. ^ • \ 
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The SRI Follow Through study^. conducted over the last five 
years by the Stanford Research- Institute has attempted to assess 
the effectiveness of a number of pilanned variation instructional 
approaches. Aside from the general findings which, based upon a 
review of available materials, indicate that follow through ^ 
programs can be successful, several interesting additional 
findings regarding approach should be .noted since they are 
directly relevant to this study: ' • ' * 

• Persons collecting data' and conducting observations 
cart , in fact observe how teaching- staff are actually 
implementing program variations. , These observations 
are much more useful than depending merely on descrip- 

' 'tions and plans;- , 

• Data collectors can be trained in the use of appr9Briate 
instruments to' conduct classroom observations of 

'treatment and control and/or corrtparison classrooms; 

• Using proper scaling techniques relevant comparisons ^ 
can be made between individualized an^d standardized 
type of instruction; 

• The physical setting and environment, including time 
usage, is an important aspect of any type of program 
operations and should be included in data collection 
and analysis phases^;' and ^ * 

• High quality control measures must be enforced durir>g 
the training of data collectors, the* data collection 
protess, and the data Jreduction and analysis tasks. 

In a subsequent section off this proposal other aspects 
the SRI study are discussed in Ifilght of the design issues 
described in the RFP. 

Since about 19 71, the Education Testing Service has been 
conducting, for the U. S. Office of Education, a study of 
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reading to identify the possible effects of compensatory education 

reading programs on the development of reading skills in the 

elementary grad^. The results of, the initially phase of the study^ 

indicates that substantial variations among schools existed in 

terms of, approaches tp compensatory education ^reading. The second 

pha^ of the^ study includes a comprehensive evaluation of reading 

program characteristics and attempts to "analyze the co^st- 

effectiveness of certain variables. Based on discussions with 

« 

individuals involved in this stu^y, several relevant issues are 
worth noting: 

• The definition o£ a program (i.e., similar studies 
receiving similar treatment) has created problems 
during the project * s, analysis phase because of the 

* wide variety of "programs". 

• Success criteria:"ipd te^if administratitsn procedures 
are being questioped iri light of preliminary findings. 
It appears that "bottoming" and "topping" affects . 
have occurred, creating difficulty in assessing actual 
vs. expected gains. To the extent that new test 5^ axe 
developed and/or Items are selected for inclusion in 
this study, it is important tt> note the degree to 
which they reflect content validity. 

Perhaps the most useful recent study which provides insights 

into the various aspects of individualized . instruction in regular 

compensatory education programs is the TURNKEY study for the 

19 

Michigan Department of Education . This study is;attempting to 
determine the characteristics of successful and unsuccessful 
compensatory education reading programs and to determine the. 
costs associated with these variables which characterise 
successful programs. ^ The fi4idings of this study have been covered 
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widely in national education media. During the year of analysis^ 
45 variables discriminated ipetween successful and unsuccessful 
programs, and over 30% of the variation in student performance 
was explain3d by per pupil cost of re^sources devoted to reading. 
While the reader is requested to review the summary submitted to 
the State Board ofJEducation in March 197S included" in Appendix J 
it should be noted that a complete copy of TURNKEY'S Report to 
the Michigan Department of-Educatipn has been received by NIE 
directly from Michigan's State Superintendent. Of specific 
relevance to this study are tiie findings that successful 
programs are more likely to have the fpllowing ^characteristics^ 
than unsuccessful ones: 

• teachers spend more time planning; 

• teachers actually select a larger portion of the 
materials used in the classroom and are more likely 
to modify, expand, or otherwise contribute to the 
development of performance objectives; 

• teachers spend approximately five times the amount of 
time in training prior to initiation of instructional 
programs ; and 

m teachers and principals have higher morale and greater 
satisfaction regarding the students and their 
instructional program. 

While these and other factors are discussed in a subsequent 
section (Task 1 — Defining Program Variables) , the relationship 
between this study and the TURNKEY Michigan Study is very clear 
and has, as a result, affected our general approach. 

In developing the remaining sections of biJr proposal it 
should be noted that members of the project team were acutely 



aware of the large amount of Federal resources planned for 
studies presently being initiated" in areas related to compensatory 
education. A recent letter dated 16 May 19 75 from the Director 
of the National Advisory Council on the Education of Disadvantaged 
Children to the Assistant Secretary of Education (DHEW) estimated 
that close to $350 million worth of studies have been mandated 
under the. new Education Amendmerxts of 19 74 . Moreover, between 
NIE and USQE, approximately $40 million is directed toward 
compensatory education. Tl:iese efforts include among others 
the $2S million longitudinal examination of cognitive gains to be 
conducted by the Off ice, of Education, While the details'' of 
many of these studies are not' available at this writing, it is * 
important to note that members of the project team are aware of 
problems and issues related" to these studies and the concern, 
expressed by members of Congress and national advisory groups 
regarding their design , and implementation • Familiarity with 
these aspects of the educational research setting are a necessity*' 
if this effort is to avoid the many potential political pitfalls, 

s 

N 
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MEMORANDUM 



TO: Dr. Joy Ftechtling 

National* Institute of Education 

FROM; * Charles L. Blaschke 

■a 

SUBJECT: Individualized Instiniction^ Study ~ Parent Involveirent 

During the July.itveeting with t^ four' contractors, you asked each of the 
contractors to consider cixoring the design study the altemative^ys of 
handling the "parental involvement"^ issue.. The sorcalled Quie Amendment, of 
course, called for the establishment of individual student goals in a cooperative 
arrangenvent involving teacher, parents, and student, with each agreeing to carry 
out certain actions. The purpose of this memorandum^ is to brief you on our 
preliminary findings and thoughts on handling of this variable as part of the 
overall Carqpensatory Education Study and^the design of &iaividualized vs. 
Standardized Instructional Substudy (I vs. S Stx:idy) . 

The specific design question vhich we have attainted to address, very damply is, 
"How to treat parental involvatient in the overall study of Individualized vs. 
Standardized Instruction". The alternatives appear to range froai: treating 
specific types of parental involvement as program variables in the ancdysis; to 
using parental involvement as*a sanpling variable in the sanple selection design; 
to conducting a descriptive case study approach of parental involvement in .well- 
iit5)l€nBrited programs; to various combinations. ^ 

Design Approach 

In order to address the above questions, we outlined three major tasR^: 
(1) the developnent of a data base identifying specific projects invoiviiig 
parents; (2) the identification of the policy research issues and questions; and 
(3) the analysis of alternative study designs and approaches. The activities 
undertaken in each of these areas are described belcw. 

(1) Developnent of Data Base ^ 

Since we were more interested in identifying specific parent involvement 
projects rather than determining the degree to v^ch parents are involved 

« 
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generally across all educatioji^pzograms, we immediately focused upon programs 
with legislative or regulatory requireraents to 'involve parents. , Moreover, 
since 0MB clearance was precluied,^ we relied' heavily upon existing documentation 
frcxn various sources, iiy::lu^!ng_-the TUHNKEY file ani our experience in programs 
involving -parents in ISOiQ^ .ahd 20 SEAs. 

First, we caitacted:.the National Advisory Council for the Education of' 
pisaA'antaged Children a strong advocate of parent^ involvement, viio assisted 
.us in identifying thirteen ex^tplary prograjus ^ involving parents . For the most 
part, parent involvement in these projects focused upon policy issues and program 
goals rather than direct involyQ:tent in insta^tional programs. 

Second, we reviewed project; abstracts as \>^11 as detailed iinplementatipn 
procedures for the' Follow '^nirough models. It would appear that seme FoIIot^ 
Through models are^^slgned as. ittuch to train parents to be instructors^ leithS 
in^'Che classroom.or at hdte, as they are designed to instruct children. ^BasedT ' 
upon the review of" docurae^rt^- without, any indepth verification', the preliminary ^ 
findings in Figure I illustrate .the nature ^pd, extent of par^tal invblvOTentf 
in the FdSewJltaough-ri^ " j> , - . ' 

^ ' _ _ \t * ^ 

,_-^iird;^ as .reviewed other potential candidates, such as those- 
identified as exeirplary Title I projects and those submitted to, the Dissemination 
Review. Pane_i„XUSpE) ,' we identified a number of additional 'projects vhich 
involved parents^ to varying degrees, ranging fron parent advisory camiittees 
' vMch provided .planning and evaluation functions, to direct parent invglvement 
in the instructional process at school and at heme. It shoxold be noted that a 
number of exeaiplary Title I programs identified for national validation 
purposes in the Dissemination Review process and/or identified for the 1973-74 
Ccnp Ed Education Fair were 'disqualified upon on-site visits tJy the USOE 
iHDnitor' and/or validation teams because the specified "parental involverent" 
existed oily on paper (i.e. , unoffigially reported by USOE Title I staff) . 

Fourth, project team members also took an inventory of projects viiich 
have been planned, developed, evaluated, and/or audited by lUPNKEY over the 
last five years. Documentation of the following categories of projects wre 
reviewed: a) 23 districts involved in the Chapter 3 program in Michigan, yMch 
requires invDlvemsnt of the ccntnunity/parents in planning and evaluation; 
b) 10 projects involved in the Chafjter 4 program in Michigan v^iich requires more 
extensive parental involvement; c) 'the 4 urban districts involved ih the USOE 
Incentives Project, for which TURNKEY was responsible for conducting extensive 
parent interviews and observation; d) Fairfax County Title I program audit of 
parental involvanent in all Title I schools; e) parent- teacher- student contracts 
in the Detroit Public Schools, initiated in 1971; and f ) the results of the 
Michigan Cost-Effectiveness study, v^ich "explored" the impact of parental 
involvement upon student performance in a limited sample. 
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Fifth, vfQ reviewed a limited number of available studies/reports of - 
projects designed to ensure parental involvement. These included the parent 
study in tha feasibility ^tudy for the vouchers program in West Hartford, 
Connecticut; the preliminary results of the Rand Study of the vouchers program^ 
in Alum-'ttock; the .process evaluation of ^±e^Parent Advisory Group in the Dallas 
School District conpensatory education program; a review of "very soft" , 
evaluative data on the 20 Hate Start Programs sponsored by DREW, ' 

And lastjp vfe "discovered" two 'very useful documsnts (neither of \^^lich 
has had wide distribution) , which suppoirted not only our tentative inclinations 
but also the study design which we v^re seriously considering. The first study, 
conducted by Steams and Peterson (1973) , was a synthesis of existing research ' 
. on parental involvement to assist in p^l2^forinulation at USOE (OPBE) ; the 
second was a paper presented at the OECD (1^73) by Datta on pair^nt involvenent 
in early childhood education in the U.S. Both reports provided a gpod conceptual 
framewrk for discussing and analyzing parental ii^volvement — its growth in 
education, the underlying philosophy and principles, the lnpact on students 
and parents, and the fertile areas of research — as described in ^ thfe Proposed 
Design attached to 'this menorandum. 

Summary of Directly-Related- Findings 

, - While each of the findings noted' below is described in greater cietail*^ 

in the Proposed Design, the most critical findings influencing our selection of 
a design are noted belcW. 

A. ^ ' Very little research has focused priimrily ah3 specifically upc^ 
the effects and effectiveness of parental involvement upon student growth in 
pognitive and affective areas. The impact of parental involvement on schools 
and districts, policies and procedures, has been documented; yet, no serious 
research investigations have been conducted. Both findings support the justifica- 
tion for NIE to include parental involvernent as a separate substudy of the 
overall Car^^ensatory Education Study, or a large ccnponent of existing or 
planned substudies — if for no other reason than it's expanded role in 
compensatory education with only modest evaluation efforts. >^ 

B. The spotty research vMch has been conducted indicates and/or 
otherwise provides seme evidence that: 

m parents trained as tutors of preschKX)l children do have 
a positive iirpact upon cognitive growth; there exists 
very little or no evidence that a similar relationship 
holds for older students; 
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• parental involvement as decision-makers and/or participants 
in classroan instruction does result in increased self- 
esteem on the part of the parents, yet little or no inpact 
on students; 

• * parental involvement in the form of aides and classrocrrt' 

assistants to teachers does have an effect on classroan 
organization and procedures, and provides the opportunity 
, for more individual attention for children; 

' • parental involvanent in vioatever form is difficult to obtain, 
even if the district is willing, due to financial and other 
constraints upon parents of ocn^^ensatory children; 

• evidence that parent involvonent raised comiunity conscious- 
ness or leads to school reform is -not consist^t. 

C. Parental involvement varies among programs in terms of quality, 
type, and extent, often reflecting differences in the legislation and/or Federal- 
SEA guidelines and regulations • While it is extrarely difficult td categorize 
various projects into "types of parental involvement", especially based upon 
existing documentation, the following exanples under various categories are 
listed in descending order of occurr^|c?e in projects as identified during the 
I vs. S Study design phase. 

f , • Parental Involvatvent through Parent Advisory Conmittees (PACs) : 

PACs in most federally and state funded corpensatory 
education programssfis nandated; more attention appears to be 
directed tovards planning and the establishment of overall 
program goals than time devoted to evaluation^ In most 
instances, unless parental involvement is specified as a 
special canponent (e.g.. Title I in the District of Columbia) 
or has high priority at the Board of Education or at the 
Superintendent level, such as in Dallas, the PAC activities 
will be relatively passive and miniinal. 

• ^ Parental Involvement in the Classroan : Assistance as aides 

ranges from clerical administration to assisting in non- 
professional tasks such as ensuring the availability of 

children. Parent volunteer 
of inner-city school systems. 
Training is usually conducted on a non-structured, infomial 
basis by the classroom teahher; in certain instances, such as 
the Grand Rapids Title 1 SbniTver Program, training is provided 
by the publisher's consultants. 



appropriate materials for 
programs exist in a number 
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^ Parent Assistance in "At-Hctne" Instruction : Programs 

designed for parents to instruct at hcnve are generally un- 
structured; training is informal, suggesting activities. 
Significant exceptions include the Parents Assisting Kids 
(PAK) and SPARKIE projects in VfeynerWestland vMch prescribe 
specific learning activities for pre and early schoolers; five 
Follow Through models (e.g., Georgia State) train parerfts . , 
to instruct children--kup3?escribed activities in the beetle j 
the' Florida migrant progr^ provides, thirough a contractor, 
intensive ard extensive' instruction in l^sic* skills £b parents 
* who in turn teach these skills to children ia the heme. 

♦ • Parent Involvement in Establishing Individilial S^jd^t 
^ (^jectives ; Most PACs fpcus on broad program o|>j Motives , r 

^ • rather than individual* stud^t' objectives. i!Q ^x?e^e>ctenti^ ^ 

in the California AFRAM and Bank StJbeet Follow "^mrcji^h 
models, pSirents are given the OH»rtunity to establish 
' specific objectives for* their children, working , closely .with, » 

the teacher. Dnly in a limisted number of projec^:s-'^do p^ents, 
students, and teachers actually identify and/or determirie 
the specific learning objectives to be prescribed 'for the* 
students. One such project exists in flinty Micihigan, in 
the cotraonity schools ^rogpam, funded .over the last two 
decades by the Mott Foundation. B>'Detroit, three years ago, 
a program was initiated v^ereby parents, teachers, and 
students decided upon specific objecrtives, agreed upon 
specific responsibilities, and" entered into caitingency 
contracts with each' other. Last, year five schools wp.thin 
the Detroit Public Schools utilized this process to ^ seme 
extent. 

, ' ' ' 
> (2) Policy Resetodi Issues/Design Constraints" 

Based upon discussions with groups and individuals mentigned above, 
' TURNKEY observations through involvanent in projects with extensive parental 
involvement con^nents, and upon findings and recxxtinendartioRs eminating frou 
the Steams and Peterson ^s'well as Datta reports, we identified a nuniber of 
poi^icy research questions vAiich appear, to be directly reliant to the proposed . 
study of conpensatory education. . . " ' 

A. The primary question or research issue is whether or not*- 
parental involvenent does have an impact on student 'pJerf ormance in math and 
reading and secondarily in the affective dcnain. \ ' ' 

B. And^ if it does, what type of inyi^vaiienfe is most effective Under 
what conditions? . \ » 

' Education TURNKEY Syst^ems, *lnc. 
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Does parental' involvenoit in ooipensatory^ educaltion have other 

posi-ty.ve or negative efffects on the nature of school operatidis, such as 

facilitating coirnunity support/ increasing teacher morale, ar^ reducing 
disciplinary pr(±>lems? 



"irfeans" 



D. Since parental involvement is a "goal" as well As a potential 
regardless of its "effectiveness", is it nore easily flacilitated by 

individualized instruction, (e.g., through differentiated stafang) than 
standardized instruction generally, and specifically v*iat typef of involven^t, 
if any? 

E. lb what extent can (should) legislative mandates knd guidelines 
require parent involvement and in vAiat areas, given political atd social 
realities (e.g., should LEAs or children be^-penalized if parent^ don't care to 
participate?) ? 

F. And a related issue, in what areas should the opportunity for 
parent involvement be provided (e.g. , as part of an "information network" for 
the School Board,. suggested by Steams, et al.) through the use o^what 
incentives? 

* D^sig^ Constraints 

A. The qualitative nature of parental involvement must be Considered 
and analyzed. This factor will vary frcm site to site as v^ll as proW"am to 
program (e.g.. Title I vs. Title III); yet, its inclusion is critical to the 
study. 

B. The socio-politiaal context of the ccmnunity and the policV-es 
of the LEA must be addressed in the analysis. 

C. Data cxDllection efforts must be minimally disruptive, ensuri 
considentiality of data and preservation of privacy rights. 

D. The effects and/or effectiv^ess of parental involvorvent shoul(^ 
have a high probability of being identified during the period of observation 
(i.e., SY76-77) or a well^documentQd data base must exist in order to determine 
trends. 



E. The cost of the. study should be relatively small, with the 
findings to be reported to NIE by July 1977 . 
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(3) 



Analysis of . Alternative Designs 



While there exist several alternative study designs ard/or conbinations 
which could be implonented bo address all or most of the above questions, below 
y^e have tentatively described the perceived strengths and weaknesses of 
several designs. 



Assuming that the design of District Survey I is similar to that 
described in the original and that the san?)le is truly representative of 



not, hcwever, answer the priority research, question — v*iether or rot parental 
involvement does have, an iiipact on student performance in math and reading and 
in the affective dcnain ~ in that District Survey 1 will not address the 
question of progr^ impact and effectivehess. Only in limited instances will 
existing* evaluations of a limited number of projects provide any inf onnation 
regarding this question. Through parental interviews, it could address, to sane 
extent, the perceived positive and negative effects of parental involvaiBnt in 
a general>sense. Any analysis would appear to be descriptive and very siii?)le, 
at the least, and for the most part, data oollectioh- will be based^on opinions 
and attitudes, «^ reliability^ of v^iich may be questioned. Qualitative 
differences' would be difficult to assess. And to sat^ extent. District Survey I 
could address the policy questions regarding the degree to which parents 
should be involved and the various opportunities which could be provided for 
this invDlveraeht; hcv/ever, once again,, data collection would be limited to 
parent and staff interviews regarding attittides and opinions. 

In short, this alternative would provide descriptive infontation on 
the nature and extent of parent involvOTent generally; yet, qualitative 
differences in procedures and impact could not 'be addressed. 



- The I vs. S Study 'presently, under design could address sore of the 
above questions, although the analysis and generalizability of results would be 
sonewhat limited. One could address the first two issues ~ impact on student 
performance and effectiveness of various types of involvement — only in a very 
limited manner. While we have identified a number of LEAs and/or structural 
models, both individualized and standardized, which Ihvolve parents in one or more 



Alternative 1; Rely on District Survey I 




Alternative 2; Integrate intp Individualized vs. Stardcurdized Substudy 
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categories n^tioned earlier, telejiione discussions with project staff and our 
own experience compel us to note the^^st differences in the quality of that 
involvanent. The' nature, extent, and quality of training also varies from 
program to program and from parent to parent in certain cases. At the most, 
one would have to identify several indicators of the type of involvement, » 
infprmtion about vfeLch would have to be objective and observable. Types of 
analysis would be limited to siirple "analysis of variance" applications of 
high achieving vs. lew* achieving programs. Also, since it would be extren^ly 
difficult and time consuming^ to verify the type and qualitative nature of 
involvement dmring site selection as a sanpling variable, one could not be 
assured of the\;epresentation of the four types of involvatvent in each of the 
treatnvent cells. > ^ 

It would appear that one could address the question of whether parental 
involvement (e.g., as an en& it itself) is more easily facilitated by 
individualized vs. standardized programs. One could rather easily identify 
the^ potential areas in viiich parental involvement could oc^^ in a very 
individualized program as a result of the opportunities for differentiated 
adult roles in the classroom and the specific nature of activities for 
individual students, similar to the matrix presented in Figure II. Then, 
through observation and other data collection means, one could objectively^ 
determine the degree to vAiich these opportunities are offered, as vvell as the 
degree to i^ch they are realized, with possibly seme reasons, taking into 
account the socio-political milieu in vAiich the family, comnunity, and school 
relate, and overall LEA. policies. 

The major disadvantages of the above, however, are: a) any findings 
from the above analysis vrould have to be considered exploratory requiring 
cross-validation in subsequent years; b) generalizability of findings would 
also be limited by the inability to take into account qualitative differences; 
c) data collection time and cost, especially if observation is required 
regarding at-hcme instruction, would be extremely high and risky, due to the 
sensitive nature of the policy research questions to be addressed. I4ost " 
critically, issues such as confidentiality of data and privacy could create 
adverse ramifications v^ich could jeopardize the overall. substudy. • 

Alternative 3; Conduct Planned Variation Experiments 

PlcCnned variation experiments could be designed for assessing the 
relative effectiveness of "parents as employees" and "parents as tutors"* (e.g., 
school age students) through randan assignments. While suggesting this 
approach. Steams and Peterson recognized the technical limitations and . 
political sensitivities (e.g., precluding a parent from participating in the 
treatment) . They suggest that a case study approach would appear to be more 
appropriate for assessing the effects of "parents as decision-makers" . 
However, in proposing the'alx)ve they recognize the need to obtain much more 
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descriptive informtion ^nd documentation on existing programs, v\4iich vafy 
considerably, in order to formulate hypotheses and concept;ual models, prior to 
large scale planned variations. Essentially, we agree with this assessment of 
planned variations at this time for additional reasons — one year of ci)serva- 
tion would be too short to observe differences and the costs would be higher 
than we anticipate NIE is willing- to allocate to the effort now. 

Alternative 4; Multi-Faceted, Integrated Design 

^ , The proposed design is multi-faceted (i.e^,. , consisting of several 
ootnponents designed to answer" several questions)^ with suggested portions 
integrated, into both Survey I and the I vs. S study. The degree to which it ^ 
can and should be integrated into the two studies is, of course, dependent upon 
the desijgn selected for the I vs. S study and the desires of NIE as it considers 
the ti;ade-offs between cost-savings and potential jeopardization to the I vs. 
S stuay. V ^ * - 

First, we assture (if not propose) that questions related to the nature 
.and extent of the various types of parental involvement in oorrpensatory 
education programs particular ly ESEA T'itle I, be addressed adequately in 
Survey I . . Perce'ptions regarding the, degree of involvement viiich could and v 
should exist could also be 'addressed. . 

Second, we propose that I vs/ S study focus upon: a) the degree to 
\^ch individualization jprovides oj^rtunities for various types of parental 
involvOTent; b) the degree to vduch these opportunities are observed under 
vAiat (Conditions; and c) to the extent possible and depending upon the cottposition 
of the sanple, the association -(not c^sality) of the various types of parental 
involvement .upon outcome ineasures. Qualitative differences will not be 
addressed due to inhferent sensitivies and costs of collecting valid survey and/ 
or observational data. ^ Care must be taken not to allow parental involvement 
elements in I vs. S ,to jeopajpdize the entire study. 

Third, we propose a twD 'part separate study (coordinated to the extent 
described aboye) consisting of: a) c^se. studies of exemplary programs (e.g., 
Title i) v^ch involve parents in v^ious (^ecision-iraking/advisory roles; and 
b) an exploratory study coctparing matched schools which vary with respect to a 
sp^ific type axxi/or coitfcination of parent ihvolvement as paid aides, as 
volunteers, and as tutors, as described in the attached P3;x)posed^E)esign. 

Ihere exist several advantages of the above approach. First, it 
facilitates an exploratory study vdiich will^ assist in developing models and 
variations for future stidies which could focus upon causality. Second, it 
minimizes jxrtiential adverse ramifications for the I vs. S study. Third, as 
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designed it increases the prciDability of district participation (e,g,, an 
evaluation of PACs could be perceived as a Federal audit iri sites where 
.parental involvenient is not considered to be "exonplaryV) , 



Charles Blaschke 
President 
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Proposed Design 

SECTION I: BACKGROUND " ^ , 

A. Introduction ' \ ^ ' 

Parental involvement as a requirement in' compensatory education evolved 
reflecting various pressures over the *last decade^ And, the expectations for 
parental involvement as an instrument to bring about integration of disadvantaged 
into constructive participation in our society emanated froip a variety of iVgics 
which were never fully articulated. 

The Great Society and War on Poverty provided parents with ojportuni ties 
for participation as change agents refoj^ng social service organizations, in-" 
eluding public schools. By changing the status of the poor, Ihus increasing thei 
self-esteem, it was belieyed that this change in status would be critical in 
breaking the cycle of poverty as children's perceptions of themselves changed. 

Second, since education was considered a critical element in the Great 
Society, as reflected in the EGA of 1964 and ESEA Title I, parental involvement 
in compensatory education was considered to be a critical element for several 
reasons • On the one hand, early re<^^^^rrh in the 60s suggested the importance of 
parents in pre-school education for children. . Shortly after that, thre Coleman 
Study results reported that home environment explained much of the variance in 
achievement of children and that high achievement was in some way associated .wi th 
the status of parents and their involvement with the^r children. 

As a result of the above, durifig the mid 50s, parental involvement in ESEA 

Title I was "suggested" and later "urged." In reality, parental involvement 

consisted of more rhetoric than reality and, in limited instances, parent control 

issues in inner-cities bolstered the notion of community schools; however, focus 
* 

of attention was more political than educational. In the^ early 70s, parental 



involvement in Title I became institutionjil ized with tT^e creation of district- 
wide Parent Advisory Coimittees (PACs). In addition, there emerged several 
advocacy groups such as the National Advisory Council for Education of Disadvantaged 
Children*'and others which lobbied for more intense parental involvement. And 
since 1973, Florida legislation requires PACs for all schools in the state/. 

More recently, federal rules* and regulations in Titles such as ESEA Title I have 
* 1 • 

mandated parental involvement not only on a program district-wicle basis but also 
at the building level. . ' ' 

During this same tinje period, very few serious evaluations* attempted to de- 
termine the degree to which, if any, pareatal Involvement was related to student 
. achievement in cognitive areas as well as growth in other domains. The US .Office 
of Education sponsored several experimental and Study efforts j^ich tangential ly 
attempted to ^provide answers to this question. The Project in* Use of Incentives 
(1972) was designed to determine the impact on student achievement through the 
offer of incentives to parents.. Due to various reasons (see Evaluation Report 
submitted by Planar Corporation, 1973), the results of this study did not shed' 
much light on this issue. Concurrently, the Office of Economic Opportunity / ' r 
attempted to sponsor experiments with vouchers programs designed to provide con 
sumer choice.. Preliminary findings from the Alum Rocksite also remain inconclu 
sive. 

However, the belief that parental involvement is directly associated with im- 
proved student performance has prevailed in writings such as Educational Inequal|ity 



C1973) by John Hughes, who recommended the use of contracts between parents and 
% schools providing for structured review of grievances and remedy. 

A study conducted by Stearns and Peterson (1973) attempted' to synthesize 
findings related to the impact of parental involvement. Aside from positive 
results when parents were involved in pre-school education programs, they conclbded 
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the empirical data available at that time was inconclusive regarding the impact 
of parental involvement in education generally. While observations and quasi- 
evaluations of the iippact of parental involvement on student achievement were 
neutral to slightly positive, the public* s demand for accountability tended to 
recognize parental involvement as an end in itself as well as a potential means to 
increase student performance. It was in above context that the Quie^ amendment 
was "introduced in the summer of. 1973. 

' Subsequent'to the introduction of the Quie amendment as noted earlier, parental 
involvement, has increased due in part to more rigid guidelines and requirements, 
and increasing program audits by USOE and state agencies including mandated 
validations. In addition, remedy has become more credible ranging from threatened 
lawsuits to being disqualified as nationally-validated exemplary projects. • 

Parental involvement is mandated in a large number of programs including the 

* 

Follow Through models, Right-to-Read programs demonstration projects under 
Project Home-Start, as well as ESEA Title I. Again, however, aside from the work 
done by Stearns and Peterson, and a concurrent effort conducted by Datta, no 
serio'us attempts have been made to determine the impact of parental involvement 
on student growth and if positive, what specific types of involvement appear to 
be most effective. 
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B. Conceptional Models and Rationale for Parental Involvement 

In their 1973 study, Stearns and Peterson at^tempted to develop several con- 
ceptual models of parental involvement in educatidn. In addition, they proposed ^ 
several justifications with possible "chain 'linkages" which could be used as 
hypotheses for* analyzing parental involvement in compensatory education- 

First, parental involvement could be classified into three categories: 
a) as tutors , where parents provided instruction, reinforcement, or other suppbrt 

> 

services at home for their children; b) where parents participated a.s aides or 
assistants to teachers in the classroom or as cofimunity w^^ers or school -home 
cbordip.atcrs as paid employees; c) parents as advisors or decision-ma kers . Datta 
(1973) identified another function of parental involvement, namely to provide in- 
sight to teachers regarding the cultural background and sen^t|i v-^ties of children- 
Recently, the role of parents as volunteers in the classroom, has emerged as an 
additional role for analysis', 

As decision-makers and advisors, a typology from RLTI (1972) indicates five 
functions including: a) the placation role, designed essentially to keep "noise 
levels down"; b) the sanctions role, desired to sanctify already established goals 
and ODjectives; c) the information role, designed to provide information to the 
community and hopefully Solicit support; d) the checks-and-b^ance role, designed 
to set in motion a series of events to assu)^e substantive change over tirh^. Over 
time ESEA Title I parental involvement has gravitated on the continuum from the 
placation role to the check-and-balance and change agent role in 1 imited cases. 

Citing the work of Hess (1969) and Gordon (1969), Stearns and Petersen con- 
ceptualized four situational models into which schools could be classified and 
for which parental involvement could be justified and/or rationalized: 

# the "environmental deficit" model, which assumes that low SES children 

< 

suffer from an inadequate environment; hence, the need to change parental 

3G . • 



behavior to help children overcame these deficits, lending itself to 
development of "tutoring skills"; 
• the "school-as-failure" modej which assumes that, if the school can be 



academic achievement will rise ac^coj7dingly; this model lends itse>f to 
parental involvement as paraprofessionals or through participation in 
decision making processes at the building level; 

• the "social structural change" model, which assumes the need for drastic 
changes in power relationships in social institutions at the ''community 
level; parental involvement as agents of social change would therefore 
be justified; and 

• the "cultural differences" model, which assumes that cultural differences 
which do exist s,hould be permitted to per^sist as a most feasible way of 
allowing individuals to realize full potential; the types of parental 
involvement which allow the sharing of native language and culture in 
the classroom and at home are therefore justified. 



While the abpve. classifications are useful for study and analysis, it should^ 
be noted that most of the compensatory education programs in which parental 
involvement is designed to be an integral part do not neatly fit into one 
specific category; .rather there appears to be overlap reflected in legislative 
designs and as actually implemented. Moreover, while parental involvement has 
been mandated in a number of programs, the guidelines (particularly those related 
to ESEA Title I) have been relatively ambiguous regarding specific roles and 
functions. As a result, problems of interpretation at the LEA level have 
resulted in controversial federal audits and would. appear to present problems in 
any general study of parental involvement. 



changed to meet the needs of disadvantaged children, their level of 
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C. Conteptual Linkages Between Parental Involvement and Student Performance ' 

\ \ J 

• In des'cribing'^the ffndings of their survey of existing studies of parental 

involvement, Stearns and Peterson hypothesized the various, chain^l inkages which' 
« 

could exist in the three. types of parental involvement, These linkages, with 
supportive data, are' described below: ' - ^ 

t P.arents as Tutors'--- the three principal linkages include increased 
student motivation, increased student skills, and improved^ parent self- 
concept- a^ described in Figure I. Most 9^,the research regarding this 
model has focused upon prerschool children and has found strong evidence 
that parental involv,ement as tutors is associated with higher student 
performance and with greater self-esteem on the part' of 'the parents. 
However, existing studies 'do. not indicate the casual relationships (sfnce 
mpst studies have been correlational in nature).' The Coleman study would 
indicate that chain C is most pritical , assuming that parents do influence 
child's perceptions of self, Hess's research (1969) indicates that if 
parents could learn specific skills as tutors or reinforcers, the child's 
achievement would increase. Studies of Head Start provides sitnilar findings. 
As Stearns and Peterson conclude, "These studies confirm the hypothesis 
- that parents can change their interaction styles with their young children 
so that the children ar^ likely to perform better in school .. .Future suc- 
cesses would require increased understanding not only of why the particulaf* 

# 

interaction styles influence children, but also of the conditions under Which 
parents can be induced to change in ways that will promote their children's 
growth," (p. 33), ^ 
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FIGURE 1 • 

PARENTS AS LEARNERS^AND AS TUTORS OF THEIR OWN CHILDREN 



Chain A 



. Cljl-ld Motivation 



.Chain B 



Child Skill 



Chain C 



Parent Self Image 



Child sees that j^arent 
perceives his educaut4ron^ 
ad important 



Child is motivated to 
succeed in school 



Parent , learns how to teach 
his own child 



Parent gives child individual 
attention and teaches hira new 
skills 



Child learns skills better 



\ 



Child ^rforms better on 
tests ^N, — 



Parent perceives his own new 
competence. Communicates con 
fidence and fate control to 
child 



Child feels confident he can 
' perform 



Parents as Aides -A- In Figuj^e II, the general linkages are described 
.for models in whichlparents are paid prafessionals working in the classroom* . 
To the extent that parents work as volunteers and are not paid, then "parent 
income increases." in o^hain E becomes less critical. And as Oattd has noted, 
if parents were employed as school -home coordinators, the chain of events 
under A would h^^ to be modified appropriately. The direct education 
outcome of participation in these roles awaits Investigation. Howe9^rr\^ 
findings from certain studies would indicate the strong linkages in the ^ 
various chains. 

The SRI Follow-Through evaluation revealed that the presence of aides in 
the classroom did affect the amount of individual attention received by ^ 
children. Anecdotal data from Project Simple and Project Self in Detroit 
public schools, operational during the period 1971-1973, alsp suppdrt this 
finding."' Similar observations ^have beenSnade in projects in Bristol, 
Virginia; Grand Rapids, Michigan; and a number of Follow-Through models* 
The power of the other chains in linking parental involvement variables to 
student outcomes have not been studied extensively Lnd evidence supporting 
them are scarce and inconsistent. / - > 

Parents as Decision-Makers/Advisors — The single most extensive type of 
parent involvement in compensatory education is the role of decision maker/ 
advisor, indiv.idualTy but mostly collectively, through Parent Advisory 
Committees-. Existing Title I guidelines require such committee npt only at 
the district level but also at the building level. Even with thi^ increased 
requirement, no serious comprehensive study of the effects and effectiveness 
of parents in this role has ever been conducted. 



FIGURE II 

PARENTS AS PARAPROFESSIDI^AL EMPLOYEES IN THE SCHOOL PROGRAM 



Cham A 



community 
Ui:)der standing 
(Legitimacy) 



Cha^n B 



fifograra Adaptation 



Chain C 



Chain D 



Parent Self Image 
(Direct) 



Parent Self Image 
(Indirect) 



Parent serves as teacher aide* 



Chain E 



Home 

Environment Change 



Parent learns rea- 
sorts for school 
decisions 



Parent communi- * 
cartes understand- 
ing of school 
progr^aras to other 
parents 

. -'1 

P^renjts suppor^t 
school programs; 
guide children to 
pertom as required 



Parcht teaches other 
school employees about 
tarn«»t Chi Idren . 
Serves as liaison for 
children between 
s*chool and home en- 
vironment 

School program is 
apprppri ately adapted 
to children. Parent 
is success nodel for 
children . 



All childr)en^do 
bttter on achieve- 
njnt tests-^r 



Parent acquires Parent is viewed 
new classroom as teacher by the 

management skills community , 



Parent 's income 
rises 



Parent perceives Parent perceives Parent moves, re- 
own influence on new social status, turns to school^ 
*class, grows more gets increased takes other action 
confident self-esteem to improve his SES 



Con:tidenc,e is 
transmitted to 
own child 



Own child do^s 
better on 
achievement tests 



Home environment 
provided by parents 
changes 



*If parent wer« employed as school^home coordinator, Chain A would be elaborated. 



The chain of events for this model are described in Figure III. 
Based upon the sketchy evidence from a variety of studies, most of which, ; - 
however, relate to pre-school (e.g., Head Start) programs or parental 
involvement in social services other "than education, it should be noted 
also that the chain linkages described in Figure III will vary in degree 
and juxtaposition depending upon which of the five roles discussed pre- ' 
viously is predominant in the particular site. 

The parent or "community understanding" chain, referred to by Stearns 
and Peterson as "legitimacy", appears to be comnonsensical for most programs 
especially where a general consensus between Ihe district and parents on 
goals and objectives exists or can be generated. Support for this "chain" 
has come from Follow Through studies, the USOE Project in Use of Incentives 
Turnkey (1972), "Validation of Grand Rapids EMR Project" (Wall, 1974) and 
observations of projects recorded by the National Advisory Council for 
Education for Disadvantaged Children in several Annual Reports (1974-75)/ 
Chain B, Program. Adaptation, has been supported by numerous studies 

♦ 

such as those conducted by Gittell (1970) and several Follow Through studies 
"Changes in institutions" (second link in chain B) have been supported by 
Folfow Through studies, studies of selected Head Start projects, and docu- 
mentation in a' number of districts which have moved toward the community 
school or alternative school concepts (e.g., Flint, Michigan; Oakland, Cali- 
fornia; and Dallas, Texas). The strength of chain C, Parental Fate Control, 
has been supported by several studies reported by Stearns and Petel^son, and 
interviews with Follow Through project representatives. 

While the above and other studies appear to relate the strengths of the 
above chains, it is important^to note that the impact of decision-making 
roles has not been correlated with student achievement, perhaps because so 
few studies nave attempted to do so. 
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FIGURE III 
PARENTS AS DECISION MAKERS 



Chain A 



Chain B 



Chain C 



Community Understanding 
•(Legitimacy) 

brents learn of the prob- 
eras involved In making, 
hanges^ learn reasons for 
ecisions^ constraints on 
professionals, etc. Be- 
ome sympathetic and 
supportive of program. 

■ I 

>arents communicate 
mportance of educationSil 
)rograms and requirements 
yf school to other parents 
sind to ow^i children. 



Parents support 
and feel respon* 
• sible for 'success 
of program which ^ 
they helped to 
initiate/ 



Program Adaptation ^ 

Parents make ^'ecom- 
raendations about how 
to improve school 
prograin fgr their 
children, 



School program is 
changed according to 
parents* recommenda- 
tion; becomes more 
appropriate to par- 
ticular ' children 
served. 



Children's level of 
achievement rises 



Parent Fate 
Control 



Parents note 
their effect on 
►shaping school ^ 
program; feel 
some control over 
own environment ; 
communicate this 
attitxide to own 
chililren • 
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SECTION II: STUDY DESIGN 

In the previous section, we discussed the evolution of parental involvement 
particularly in compensatory education, various roles and models, and hypotheti- 
cal linkages between parental involvement and student achievement. In addition,' 

f 

findings of relevant studies which support these and other .1 inkages were noted. 
In this section, we list -some of the policy research issues of interest to NIE 
in its overall study of compensatory education, the specific issues to be addressed 
in this study as well as those to be addressed in other NIE-sponsored studies, and 
some of the major problems and design issues to be addressed in the proposed study. 

POLICY RESEARCH ISSUES AND QUESTIONS 

An initial question is the degree to which what types of parental involve- 
ment exist in compensatory education programs generally and specifically ESEA 
Title I. This issue is' being addnessed in District Survey I, which consists of a 
nationally representative sample of compensatory education programs conducted by 
NIE during the school ye^r 1975-1976. The impact of parental involvement is not 
addressed in District Survey I, however. 

Second, a critical issue due to increased Congressional interest and lack of 
evidence from prior studies mentioned earlier, is whether or not parental in- 
volvement does have an impact on student performance in math ^and reading. And,- 
^if it does, what types of parental involvement are most effective under what 
conditions. This issue is being a'^dressed obliquely in the study of Individual ized 
veijsus Standardized (I vs S) programs to be conducted under contract to NIE during 
school year 1976-77. This particular study , -h^ever, will neither address quali- 
tative issues nor attempt to identify specific procedures related to soliciting and 
implementing parental involvement. The. contractor selected for"* this study, however, 
may wish to utilize the "data base" from the above study as well as District Survey I 
'*n sample selection. , . 
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Third, does parental involvement in compensatory education have other posi- • 
tive (or negative) effects on the nature of school operations such as facili- 
tating community support, increasing teacher morale, reducing disciplinary problems', 
etc? This issue is not being addressed in any detail in the above two studies 
and will be addressed in this study. 

Fourth, to what extent is parental involvement (as an end in itself rather 
than as a means to. facil itating student achievement) more easily facili*tated by 
individualized instruction than through traditional or standardized instruction 
generally, and sepcif ically^ what types of involvement, if any? This specific issue 
is being addressed in the I vs S Study, yet the generalizability of the results 

Q 

^will be extremely limited. * « 

Fifth, to the extent that parental involvement is associated with student 
achievement or is desirable as an end in itself, what are the specific processes 
and procedures which have been used in exemplary projects which are replicable 
for use in programs elsewhere? What are the conditions which are conducive to 
the effective implementation of these proceudres? Also, what barriers exist? 
What incentives, if any, could be provided to facilitate greater or ijiDre effective 
participation through what rules? To what extent are existing guidelines clear in 
specif lying the types of involvement intended by Congress? The above as well as 
a number of otHer questions constitute the major focus of this study, as described 
below. 
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Pjjrpose of the Study 

</ 
4 

The purpose of this study is to: 

• Document, describe and analyze effective procedures for 
planning and implementing exemplary parental involvement 

• programs in compensatory education programs, particularly 
ESEA Title I: To accomplish this, the contractor will 
identify exemplary si'tes and conduct case studies of pro- 
jects which provable for the five roles of combinations 
thereof under tlie'' decision-making/advisory model. 

• . [ To develop and/or refine hypotheses i?e]ated to tbe impact 

of the various types of parental involvement on student 
achievement. This objective'will be accomplished through 
an updated survey of research -bn parental involvement over, 
the last three years, the evaluation of selected exemplary 
districts which are utilizing specific .types of parental 
involvement t:hrough a matched treatment vs. comparison 
group. Specific focus will be placed upon parents as 
tutors and as aides/ 



In conducting this study, several design constraints must be met:, 
a) that the qualitative nature of parentaf involvement must be an integra-1 part 
of the analysis; b) that the socio-political context of the community and policies 
of the LEA must be addressed; c) data collection efforts mu^t be minimally dis- 
ruptive, ensuring confidentiality of data and preservation of privacy rights; 
. d) the effects and/or effectiveness of parental involvement should have a high 
probability of being identified during the period of observation, (i.e. school year 
1976-77) or a well -documented data base must exist in order to determine trends 
iri the respective sites; e) that the focus of the study be. placed upon ESEA 
Title I programs with findings to be reported to NIE by July 1977. 



o - AG 

ERIC 



Design Considerations/Issues • 

Even though overlap exists, below we have attempted to separate the issues/ 
questions to be addressed in the case study approach and those to be addressed 
in the comparison study. This list is not intended to be exhaustive but rather 
suggestive for consideration. 
A. Case Study Design Issues . 

I . Planning for Parental Involvement ^ 
Since the nature, extent, and procedures used for involving parents 
in the planning of the parental involvement programs appears to be critical, a 
number of questions need to be addressed in the study of exemplary projects. 

• On what basis was a decision made, and by whom, to initiate a 
parental involvement component? Federal guidelines? SEA guidelines? ^ 
Local initative? What were the major political and educational issues 
debated? 

• Since allegations have. been made regarding the ambiguity of Federal 
guidelines, especially Title I, what procedures were followed at the 

" LEA level for interpreting guidelines and ihen designing the parental 
involvement component?. Who was involved in this process? How where 
conflicts resolved? Over time, how have ch^anges in guidelines been 
integrated into the program? What factors have contributed to con- 
formity? 

• How was the initial selection of membership to the PAC determined? 
Elective? Appointive? Was the initial composition of the PAC repre- 
sentative of the entire coipmunity or of specific \tested interests 

and concerns? 

• . What were the priorities, and the procedures for establishing prior- 

rities by the PAC initially? What type of support, (e.g. presentation 



of alternatives), was provided by the LEA? Were criteria for in- 
dicating achievement of objectives specified in advance, and were 
they met during the initial years of operation?^ And later? 
What was the organizational structure of the PAC? Formal? Informal 
Combination? What decision-making or other functions were delegated 
to the PAC? To what extent was program feedback provided to the PAC 
during the initial years of operation? To what extent did this feed 
back influence the decision making? 

• What types of training (e.g., planning, evaluation, etc) were pro- 
vided to the PAC? In what areas and conducted by whom? To what 

• extent were these skills used? 

IL Prograun Operations 

t To what extent were parents willing to participate in the planning 
as^l as operations of the project where appropriate? What were 
the major barriers and problems (e.g., financial constraints, availa- 
bility of time, feelings of psychological inferiority, social inade- 
quacy, etc.)? What procedures were used initially and those which 
evolved over time appear to be most effective in accomodating the needs 
of parents' (e.g. , Title I, non-Title I) for effective participation 
(e.g., released time for "working parents). 

• What techniques were used to ensure that initial enthusiasm, where 

it existed, continued throughout the operations of the program? What 
were the major factors which contributed to greater enthusiasm 
(e.g., parents seeing achievement in their own children) and those ^ 
factors contributing to the lack of enthusiasm (e.g.; anticipated 
resources failed to materialize, bad communications, etc*)? 
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« -In areas where conflict arose, what procedures were used to re- 
solve conflict, or at least gain cons.ensus on areas where agreement 
was possible? 

• To what extent did membership of the PAC and parents in general 
follow agreed-.upon objectives and implementation plans regarding 
the program as well as parental involvement components throughout 
the year? To what extent did the PAC get involved in issues beyond 
the scope of its prescribed activities (e.g., spokesman for integration 
plans, selection and'hiring of staff, active participation in national 
lobby groups, etc. ) 

III. Parental Involvement in Evaluation/Planning 

• Where appropriate, what role if any did the PAC play in resolving ^ 
questions regarding comparability and Federal audit issues? Were the 
issues explained adequately to the PAC? What position was taken? ^ 

• What was the nature of the PAC involvement in evaluation? Was adequate 
training. or orientation provided by the LEA staff or others 'prior to the 
final ization of the evaluation design? To what extent were evaluation 
results reported .in a form usable to the members of the PAC? To^hat extept 
was there conflict in the priority assignment of criteria to be used in 
program assessment? 

• To what extent were general expectations met? And what tfnpact did the 
actual accomplishments, compared to expectations, have on the PAC generally 
and specific types of parental involvement in future programs? 

IV» Social - Political Context 

• To what extent did the type of parental involvement which was implemented 
also accomplish political goals of the LEA, of the. PAC itself and/or others 



(e.g., teacher visits to homes to help parents ostensibly but in turn 
to change teachers' perceptions of home environment)? 
• Did participation of one group or community of parents create schisms in 
the community generally because of different political perceptions of the 
reasons 'for participation? What type of school -parent-community relation- 
ships ^existed prior to the implementation of the parental involvement - 
program? . • \; 




B* Case Study Approach Problems 
Case Studies 

In conducting the case study of exemplary parental involvement programs, 
several issues and problems need to be confronted. 

First, selection of exemplary programs will require extensive review of 
documentation and verification prior to final selection of candidates. While a 

large number of LEAs h(ye documented plans and procedures regarding the activities 

> 

and functions of the PACs, in most instances the ways the PACs operate- differ sig- 
nificantly. For example,^ large number of exemplary Title I programs selected 
for submission to the dissemination review panel (USOE) were disqualified during 
on-site validations by Title I monitors due to the discrepancy between PAC plans 
and actual implementation. The contractor might consider soliciting nominations 
from selected SEAs which emphasize parental involvement to an extent greater than 
required in guidelines. Or the contractor could work through the NACEDC, which 
has compiled a state-by-state data base on PACs and their functions. In addition, 
a data base with accompanying documentation exists for a number of projects in the 
District Survey I and the Individualization Study, although the release d?Vthe data 
,in the case of the former is limited due to confidentiality obligations. T 

. Second, data collection will be a>very sensitiv^^'task as well as difficult 

* 

in certain cases. Sensitivities related to assessment of PAC operations as 
decision-making and advisory functions will be reduced somewhat by the selection 
of exemplary programs; however, due to extensive Federal audits in this area, per- 
ceptions will still be difficult to overcome. In addition, in collecting trend 
and longitudinal data, it is anticipated that a high level of effort will be de- ' 
yoted to gathering documentation and evidence through program audit techniques; 
yet, since LEAs typically either do not document activities and procedures land/or 
destroy files after a period of time. The contractor should consider the 
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Column 2: 

* 


In how many of the already mentioned grade 2 classrooms 
whose coTp ed students are provided specific si^plementary 




\ 


instruction is this program used fer this specific 




supplementairy instruction? 




Column 3: 


Same question as Column 2 but for the grade 3 classrooms 


t 




already mentioned. ' , 




Column 4: 

• 


In how many of the grade 2 classrocms included in Ctolumn 2 
is the stipplement^ry carp ed instruction provided in a 
classroom setting which physically separates the ccnp ed 






studen^ fron their non^cdrp ed classmates {e.g., in a 
separate reading center)? 




Column 5: 


Same j^iefetion as Column 4 but^^r the grade, 3 classrooms 
included ^ in Column 3. ^ ' 


J, 


CoIiSttn 6: 


Enter the' letter (A, B, C, qi^ p) corresponding to the statement 

• * * It 
listed below ^^ch best describes your assessment of the 

effectiveness of the program named, in Column I in improving 

the skills of grade 2 and grade 3 oonp ed students and the 

degree to vdiich this program is operating according to your 






uixJerstanding of* the overall design or recotinended educational 






plan for that program: 


« 




A) The program' is effective and operating according to my 
uirier standing of its plan. , ' ^ 

B) . The p^pgram is effective but could be improved "?ur€her 

by operating it more in accord with my understanding of 


1 


4 

• 


its plan, • * , * * 
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availablity of adequate documentation as a prime criterion in site selection. 

Third, due to the inherent pol itical nature of parental involvement in con- 
structing case studies of procedures and rationales, getting respondents to re- 
veal actual vs. publicized justifications may be difficult indeed. For example, 
in one district which has implemented a highly successful parental involvement 
component, the superintendant initiated a program whereby teachers visited homes 
to train parents in tutoring skills; however, the hidden agenda in this case was 
td force teachers to view the home setting and develop empathy with the child 
regarding problems congronted in the home. And in turn parents in many cases will 
seek membership on PACs for reasons other than those that appear on the surface. 



The data c^lection effort must probe to the extent possible in collecting valid 

data, but at the same timd, ensure conf identiallity of respondents and minimize 
disruption to the overall project. * 
C. Comparison Study 

1. Research issues focusing upon a comparison of parental involvement 
as aides and tutors, a number of questions will be addressed. 




What types of functions can (do) parents perform in the 



classroom? What is the impact within and outside upon the 



classroom and other outcome measures? Wh^it difference are 



noted when parents are volunteers and are not paid? 



What are the specific types of "tutoring" which exists e.g 



learning activities, reinforcement, supportive) and which ones or 
components appear to be associated with student achievement? In 
exemplary programs using parents as aides or paraprofessionals, what 
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types of roles are provided for parental involvement, and which ones 
seem to be most appropriate (e.g., clerical, instructional, support)? 
What is the impact of parental involvement as aides on the instructional 
setting and classroom environment? Are there differences in student 
outcome measures as well as parent, student, .and teacher attitudes 
between treatment and comparison schools, and among parents acting 
as volunteers versus those acting as paid paraprofessionals? 
Design Constraints and Issues: Due to the constraints of one-year 
observation, limited costs, artd dependence* on existing programs (rather 
than a planned variation-intervention model or experiment), a number of 
design issues must be addressed: 

• Sample Selection -- The identification of exemplary parental involve-' 
ment programs and then the selection of matched comparisons within 
the LEA will be a challenging endeavor* The spillover of treatment 
effects (e.g* , parental involvement) to comparison groups in most 
. LEAs could contaminate the results. For example, a district with an 
expansive and intensive parental involvement program in its Title I 
school will probably require similar types of parental involvement in 
regular programs or in certain instances, some contamination will 
, still exist in Title I eligible schools which previously were involved 
in the Title I program. The matching of treatment and comparison 
schools with respect to student, teachers, and programs will also 
present logistical selection problems. Moreover, to the, extent that 
the knowledge that a comparison school is being compared to another 




school may create a "John Henry" effect (i-e., the over achieving 
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comparison group) which again could erode the design during the 
.operations of the program. Consideration will have to be-given ^to 
blinding effects and types of designs (e/g,, post test only for 
certain types of instrumentation). Data collected on programs 
ttroiigtr District Survey t ^ird^ the ftidivlduaH^tttm "Study sht5u^a - ^ 
assist in site selection. 

Measurement Criteria During this short period of observation, 
selection of instruments and criteria for indicating success will be 
critical. Studies of o,ne-year duration involving parental involve- 
ment interventions when standardized tests were used to measure 
achievement have been criticized in the past. The various types of 
outcome measures necessary to answer the above questions include 
those measuring cognitive growth; those assessing attitudinal 
chang^es in students, ^ staff , and parents; and those measuring impact 
on the classjoom environment. Since this study is exploratory in 
nature, hov^gver, and time and cost constraints preclude the develop- 
ment of new instrumentation, selection of instruments will have to be 
from those presently available^ 



SECTION III; STUDY TASKS 

The suggested tasks for completion by the confractor in conducting the 
study of parental involvement are listed below. Unless otherwise justified, the 

^contractor, sjiojjlii _aitemj)t ^j^^ .M_I!?Jch. as possible th^ research effort 

with those of District Survey I and the I vs. S Study in areas such as site 
selection and baseline documentation. Also, while generic tasks are deiscribed 
below, the specific subtasks for the case study will differ somewhat from those 
in the comparison study. * , 

Task 1 " Update Research on Parental Involvement 

The objective of this task is to update the research on parental involvement 
since the publication of the study by Stearns and Peterson (1973). While there . 
has been no subsequent similar study, a number of research efforts have dealt, 
with parental involvement to some extent. These include the SRI Follow Through . 
Stiidy, the CSC study of Early Childhood Education in California (1974), several 
evaluations of Title I programs in middle to large-stze districts,' arid documenta- 
tion assembled by NACEDC. Upon the completion of this update, the contractor will 
refine or otherwise modify the proposed design, especially with regard to areas 
to be covered in the case studies and additional "hypotheses" to be tested in 
the comparison study. 

Task 2 — Develop Sample Design , 

a1 Case Study: The sites to be included in the case study should include, 
inner-rcity schools, suburban schools and rural schools in proportion to the 
national compensatory education level of effort. The sampling should also 
include representation from two categories of decision-making/advisory models: 
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•(a) those in which the PAC meets minimal Title I guidelines in terms of functions 
(e.g., the first three categories used in the RLTI topology); and (b) those in ' 

^which parents, either through the PAC or otherwise, also exert checks and 
balances and/or change agent roles and functions . Our major interest is in the 
IdtLer. ' ttrtr cinticipated^ttTHt' app r OAii it a;tel ^ s tudies wfH be conducted. 

Once the design is complete, potential sites will be iflen,tified by the 
contractor using data gathered in|the District Survey I and in the I vs. S Study. 
It is not necessary that sites actually selected for participation in the latter 
be selected for gase stuclies. A major factor here will be the willingness of 
the district to cooperate. Once sites have been tentatively identified, specific 
disqualifying criteria will be applied using documentation or data verified by 
telephone. The criteria for inclusion in the study might encompass general 
recognition as exemplary models by SEA or national dissociations (e.g., NAEDC); 
relatively high achievement in cognitive areas; good documentation of parental 
involvement in "treatment" schools; and willingness to cooperate in identifying/ 



scheduling interviews and other data collection activities. 

B. Comparison Study: The sample design for the comparison study should 
include representation* from the above three "size" categories of LEAs and two 
types of parental involvement: (a) as tutors provi^ding instructional activities, 
reinforcement, and supportive activities; and (b) parental involvement as aides 
or paraprofessionals in the classroom, preferably including programs in which 
parents serve as both paid and volunteer aides (i.e., since appropriate outcome, 
measures will differ). 

Initial site identification could include the same sources and criteria 
used in the selection of sites for the case studies and other sources of 
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exemplary models. The ^contractor may propose additional criteria to use for 
verification purposes by telephone prior to final ization of s-ite selection 
(e.g., availability of a comparison school (s)). 

In both instances, the contractor should propose various types of 
TncentiYes necessary To^ ensure coop"era"tlah of the LEA Tn the "project. 'Special ~ 
consideration should be given to getting cooperation from the comparison schools 
in the study. 

Task 3 Define Outcome Measures 

The contractoV will define the specific outcome measures to be used in assess- 
ing the effects and impact of parental involvement on students, parents, staff, 
and classroom environment. Specific instruments should be selected largely from 
those presently available with documentation of reliability and validity. It is 
anticipated that outcome measures will be refined'based upon the completion of 
Task 1 (e.g., impact upon parents measures and criteria could differ regarding 
type of involvement). It should be noted that the instruments to be used should 
be a§ non-obtrusive, non-reactive, and non-disruptive as possible. To the extent 
possible and justifiable, instruments presently being used locally to assess 
cognitive growth, such as national standardized tests or criterion-tests, should 
be used to the extent cross program comparisons could be made. 

It is anticipated that the instruments to be used for conducting the case 
studies will be more flexible, open-ended and unstructured relying heavily on 
audits and verification of existing documentation. 

Task 4 -- Analysis Plan 

The contractor will propose a plan for analyzing the data collected from 
both the case studies and the comparison study. In the case studies, the 
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'contractor should propose a conceptual design of various models which could 



"school as failure model"); historical and trend analyses, identifying critical 

incidents, and their impacts should be addressed. 

The comparison study should be considered exploratory in"the"s'ense of 

identifying and/or confirming hypotheses which could be tested in a "planned 

variation" experiment in the future. In identifying program and/or process 

» 

variables, the contractor should take into account qualitative differences among 
programs through various scaling and/or rating procedures. The contractor should 
list tentative hypotheses in the proposal. 

Task 5 — Data Collection ^^ 
The contractor will specify a plan for collecting data for both studies 
such that the data can be collected in an efficient and coordinated manner between 
the two studies and where appropriate, with other separate studies. It is 



anticipated that the majority of data collection will be through interviews. 



as well as verify prior findings througfi the review and audit of existing 
documentation. Instruments used in several Follow-Through Models and by LEAs 
which have extensive parent involvement components should be reviewed for 
possible use, as appropriately modified, in the study. 
Task 6 Conduct Analysis 

Utilizing techniques and approaches described in Task 4, the contractor will 
conduct the actual analysis of the data gathered during the period of observation. 
The conduct of tasks related to the two studies should be scheduled in such a 
way to allow for continual analysis of data as, it becomes available in preparation 



provide a framework of analysis such as that present in Section I (e.g 



• ^ 




both structured and unstructured^ and through observations used to collect data 



ERIC 



f)9 



of interim and final reports* Assurances of timely availability of data collected 
by others {e.g.] the LEA if it conducts its own scoring of standardized tests) 
to ensure 'adequate time for analysis and reporting by July 1977* Periodic interim 
reports will be required upon the completion of each of the above tasks* 

PROJECT ORGANIZATION AND MANAGEMENT 

The contractor should propose the project organization specifying individuals 
responsible for specific activities and their respective qualifications* The 
Project Director should not only be technically competent in evaluation but 
also have demonstrated knowledge about and experience with ESEA Title I programs 
and a number of LEAs* On-site data collectors, either through survey questionnaires 
and/or observation, should be familiar with the LEA and its policies* Where 
possible part time data collectors hired from the^ocal area should be 
used by the contractor* 

The estimated level af professional services, including data collection, is 
2*5-3*0 man years over an 18-month period beginning February 1976* ' - 

♦ 
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LIST OF OTHER FACTORS 

* REIATED TO LEA's (XMP ED DIRECTOR * 

Staff Characteristics 

Whether the ccnp ed director ever taught 
readmg or math at any level in a school 
setting 

Oarp ed director's total years of school 
administrative experience 

Oonp ed director's highest degree level 
held * . 

Oonp ed director's 1976-77 annual salary 

Organization and Management of Program 

1976-77 ccmp ed funding sources in study 
buildings 

Percent of Title I eligible students in 
district actually receiving services of 
Title I funds each year 

Prinary iasis upon vMch Title ' I f xmds are 
allocated among eligible schools in'dist^ 
rict 
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Number of discussions with' each study 
school's principal in last 12 nonths on 
reading or nath activities of that school's 
carp ed students 

Percent of such discussions initiated by 
that school's principal 

Major topic of 'such discussions with each 
of these principals 

Number of such discussions vri.th the teach- 
ers of each of these schools in the last 
12^ months 

Percent of such discussions initiated by 
these teachers 
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Major topic of such discussions with these 
teachers . 

Number of visits to each stucJy school over 
last 12 ironths to observe reading or math 
activities of that school's conp ed stu- 
dents 



Number of classroonis observed per visit to 
each of these schools 

Number of ho\ars per school visit to each 
of these schools 

Vlhether the teachers of each school typi- 
cally knew of visit prior to arrival of 
carp ed director at school 

lather the ccmp ed director gave feedback 
to the teachers v^se classrooms were ob- 
served on these visits 

VJhat was typically said or done, i.e. , 
feedback to teachers 

Vlhether the cxxm ed director gave feedback 
to the principal of each study school 
after such visits 

VSiat was typically said or done, i.e. , , 
feedback to each principal 

How conp ed teachers are assigned to their 
students in district 

whether private firms played any- role/ 
other than selling materials , in each study 
school's ccxrp ed reading or math activities 

in 1976-77 

> J 

I 

Whether private firms played any role / 
other than selling materials/ in each study 
school's coup ed reading or math activities 
in .1975-76 

Reading' tests used in "district for connp ed 
stiidents, K-6 
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Average number of nonths between reading 
pre- and post-tests over grades k-6 for 
all tests used 

Whether the results of these reading tests 
are typically available to teachers within 
one nonth of testing 



Math tests usq3 in district for cccip ed 
students, K-6 

Average nmnber of months between math rare- 
and post-tests over grades K-6 for ^ 
all tests used 

Whether the results of these math tests * 
are typically available to teachers within 
one month of testing 

Degree of autonoriy the district's school 
building staff have over the pqrchase de- 
cisions for materials 



buiMLng staff have over hiring decisions * 
within tliat building 

Organization/coordinating relationship of 
carp ed director's office with the regular 
school program - 

Degree to vMch the district's ccnp ed pro- 
♦ gram delivery system has changed from pre- 
vious year 

Changes in instructional program 
Changes in staffing patterns 
Changes in materials/equipment 
•Changes in instructional time 
Changes in in-service training 
Changes in approximate cost 
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Organization and Managgtvent of Classroan ' 
Reading and Math Activities 

Type of instruction in conp ed reading or 
^math activities in each study school, 
1976-77 

-Type of . instruction in^feomp ed reading or 
math activIHes iH~^e^^ 

1975- 76 

Staff Developn^t Specifically Related to 
Ocropensatory Education Reading or Math 
Activities 

Nunber of days of specifically related 
teacher training for each study school, 

1976- 77 

Nunber of days of specifically related 
teacher training at the outset of ciorrent 
reading or math program at each study 
school 

Number of these teacher training days in 
vdiich the principal of each respective 
vas involved, 1976-77 

of these teacher training days in 
v^ch the principal of each respective 
^bhool was involved, outset 

Clumber of these teacher training days in 
vg^iich director-respondent for each study 
^bool was involved, 1976-77 

Number of these teacher trainihg days in 
vMch director-respondent was involved, 
outset, for each study school 

Whether any fornal evaluation of these 
teacher training days was conducted by 
the school, 1976-77 • 

Whether any formal evaluation of these 
teacher training days was conducted, by 
' the school, at the* outset 

General training requirements for carp ed 
paraprof essiomls in each study school 



Nuniber of cJays of specifically related 
.paraprofessional training at eacK study 
schcol, 1976^77 - • ^ 

-S^aKteer-of-^ays-^o f s p ecif i c all y relate, 

paraprofessional training at the outset of 

'current reading or nath program at each ^ 
study school ^ 

Number of these pairaprofessional training 
days on which the* principal of- each respec- 
tive school was involved, 1976-77 

Nunnber of these paraprofessional trainisig^ 
days on which the principal of each re- 
spective school was involved, outset 

Number of these paraprofessional training 
days on which director-respondent was 
involved, 1976-77, for each study schcx)l 

Number of these paraprofessional training 
days on which director-respondent was 
involved, outset, for each study school 

Whether any formal evaluation of these 
paraprofessioncd training days was con- 
ducted/ -1976-77 

' Whether any formal evaluation of these 
paraprofessioncd training days was con- 
ducted, outset 

Student Variables 

Percent of district's total enrollment 
served by cornp ed programs 

Basis for selecting replacement Title I 
students. 

"Causes" for comp ed'. students' performance 
below expectations 



School and District Variables 



Degree to which role played by PTAs is in- 
tegral and iitportant in district 

^ _V;_ ^ 

Degree*^ which role played by Parent Ad- 
visory Councils is integral and irrportant 
in district 

Degree to which role played by Tax Groups 
is integral aixJ iirportant in district 

First "Other Group" listed as powerful 

Degree to vMch the role played by this 
first "Other Group" is integral and irn- 
portant in district ^ 

Second "Other Group" lasted as powerful 

Degree to which the role played, by this 
second "Other Group" is integral and im- 
portant in district 

Third "Other Group" listed as powerful 

Degree to which the role played by this 
third "Other Group" is integral and ixor 
portant in district 

Frequency of inforimtion sent to parents 

Frequency of infornal meetings between 
district officials and « parents 

Total teacher strike days in last tvo years 
in district 

Median family incons in district in dollarsj 

Urban/Rural/etc. classification 

Net current expenditure per student in 
dollars 
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utilization of Staff Time 

Director-respondent's hours per week on 
carp ed outside of regialar working hours 

Director-respondent's nornal working hours 
per day ^ ^ 

Director-respondent's vorking days per year 

Director-respondent's percent time plan- 
ning cxxnp ed 

Director-respondent's percent time plan- 
ning other 

Director-respondent's percent time train- 
ing in carp ed 

Director-respondent's percent time train- 
ing in other 

Director-respondeht's percent time in carp 
ed decisions 

Director-respondent's percent time in 
other decisions 

Director-respondent's percent time in 
carp ed administration 

Director-respondent's percent time in 
other administration 

Director-respondent's percent time in 
other activities 

Other activity listed 

Miscellaneous Characteristics 

Number of Title I students in district/ 
1976-77 

Whether other conp ed. programs besides 
Title I operated in district 1976-77 
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'First listed other such program 

■ .r 

Number of students served by first listed 
'-.other such program 

SeborxJ listed other - such program 

Number of students served by second listed 
other. such program 

•Otiird listed other such program • \ 

Nuntoer Of students served by third listed 
other such program 

Itotal kindergarten students ^ enrolled in 

district/. 1976-77 

', ' * 
Totar grades 1-6 students enrolled in 

district, 1976-77 

Total grade 7-12 students enrolled in 
district, 1976-77 . 

Total K-12' students enrolled in district^ 
1976^77 

• Number of district's elenventary schools 
receiving Title I funds, 1976-77 

Number of elementary schools in district, 
1976-77 . * * ; • 

Number of elementary schools in district 
'receiving other carp ed funds ^ 1976-77 

Number of district 's^lementary schools 
receivix^g both TitleT: and other conp ed 
funds, 1976-77 
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** PEIATED TO A STODY SCHOOL'S PRINCIPAL * 

Staff Characteristics / 

Whether the principal ever taught reading 
or itath at any level in a school setting 

Whether- the principal is teaching pa2±- 
tinve now in his/her ^school 

Principal's total years of school adminis- 
trative experience 

Priricipal's highest degree level held 

Principal's 1976-77 annual salary 

Organization and Nlanagement of Program 

Number of years of Title I operation in 
school 

Other carp ed programs in school 

Number of years of operation in school of 
each listed other carp ed program 

Number of discussions with district's coro 
ed director in last 12 mDnths on reading 
or math activities of school's carp ed 
students 

Percent of such discussions initiated by 
the director 

Major topic of such discussions with the 

. director 
♦ 

Number of visits by director to school in 
last 12 -nonths to observe reading or m.th 
activities of school's comp ed students 

Whether the director typically provided 
feedback to principal after such visits 
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What was typically said or done by di- 
rector, i.e., feedback to principal 

Strength of teaching staff's support of 
coip ed reading or math activities in 
school 

Basis for judging this strength 

Principal's assessnvent of carp ed teachers'^ 
involvement in organizing the ccnp ed 
classroom 

Principal's assessment of conp ed teachers' 
involvement in selecting 'coop ed naterials. 

Principal's assessment of carp ed teachers' 
invplvement in reviewing/selecting per- 
formance objectives for' ccnp ed students 

Principal's assessment of regular teachers' 
involvement in organizing the carp ed ■ 
classroom 

Prixvcipal's Assessment of regul^ar teachers' 
involvernent in selecting carp ed materials . 

Principal's assessment of regular teachers' 
involvement . in reviewing/selecting perfor- 
^ roance objectives for^orrp ed students 

Principalis assessment of paraprofession^ 
als' involvement in prgeihizirig the comp 
ed classroom ^ , 

Principal's assessment of ^paraprofession- 
als' involvement in sfelecting corrp ed 
matei'ials 

Principal's .assessment of paraprofession- 
als' involvement in reviewing/selecting 
^ ' performance objectives for cctop ed stvdents 

Principal's assessment of his/her own 
, - involvement in organizing the conro ed 

.classroom 

Principal's assessment qf hisA^er own 
involvai^ent in selecting corrp ed materials 
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Principal's assessment of hisAer own 
•involvement^ in revievmig/selecting per- 
formance objectives for carp ed students 

Others besides the teachers, paraprofes- 
sionais/ and principal v*io are involved in 
these activities 

Principal's assessment of these other staff 
members' involvement in organizing the con^! 
^ed classroom 

Principal's assessment of these other staff 
members' involvement in selecting ccmp ed 
materials . 

Principal's assessment of these other staff 
members' involvement in reviewing/selecting 
perfoxitarx:e objectives for ccx^g ed students 

Method by vMch carp ed and regular teach- 

coordinate their reading or math 
a^rtivities for carp ed stxxients 

Prpicipal's satisfaction with this coord- 
^tion 

Basis for this assessment 

Ways in -^diich coordination might be im- 
proved 

lifeiber of times principal has met with 
par^t{s) of carp ed students in school to 
discuss reading or mth activities of the 
student 

Whether principal makes hone visits for.th^- 
purpose of such discussions 

Major topic of such discussions 

Method of Instruction 

Method (s) of instruction most successful' 
with carp ed students ""in school 
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staff Development Specifically Related to 
Oonpensatory Education Reading or Math 
Activities 
* 

Number of days of specifically related 
teacher training for school's staff, 
1976-77 

Number of days of specifically related 
teacher training for school's staff, out- 
set of current carp ed reading or math 
pocogram in school 

Nohber of these teacher training days on 
\Aich principal-respondent was involved, 
1976-77 

Number of these teacher training d^ys on 
v^ch principal-respondent was involved, 
outset 

t 

Major topic qfv these teacher training 
sessiqjjs, 1975fr77 

Major topic of these teacher training 
sessions, outset 

Number of these teacher training days on 
vMch district's comp ed director was 
involved, 1976-77 

Number of these teacher training days on 
vMch district's ccmp ed director was 
involved, outset 

•> 

General training requirements for canp ed 
paraprofessionals in school 

Number of days of specifically related 
paraprofessional training for school's 
staff, 1976-77 

Number of days of specifically related 
paraprofessional training for school's 
staff, outset 
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Number of these paraprofessional training 
days on vMch principal-respondent was 
involved, 1976-77 

Number of these paraprofessional training 
days on vMch principal-respondent was 
involved, outset 

Major topic of these paraprofessional 
training^ sessions, 1976-77 

Major topic of these paraprofessional 
training sessions, outset 

Number of these paraprofessional traiMng 
days on vMch district's conp ed director 
was involved, 1976-77 

NisTiber of these paraprofessional training 
days on which district's conp ed director 
was involved, outset 

Student Variables 

PerQsnt of school's current cortp ed stu- 
dents started in subject school at be- 
ginning of the current school year 

Percent of school's carp ed students ab- 
sent on any given day 

Percent of all students in school eligible 
for (^strict 's free lunch program 

Percent of conp ed students expected by 
principal-respondent to corplete high 
school 

"Causes" for conp ed students' perfOTrnance 
below expectations 

' School and District Variables 

Number of parents attending a typical PTA 
meeting at school 

Percent of total school parents this num- 
ber represents 
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Priiicipal's assessment of teacher morale 
in school 

Why is this so ' 

Whether principal is satisfied with de- 
cision-iTBking method in school for carp 
ed cuirricular natters 

Basis for this satisfaction or lack of 
satisfaction 

Utilization of Staff Time — . 

Teachers' nonnal working hours per day 

Whether this length of tine is determined 
contractually 

Principal-respondent's normal working 
hours per day 

Whether t±iis length of time is determined 
contractually 

Paraprof essionals ' normal working hours 
per day 

Whether this length of time is determined 
contractually 

Reading or math specialists* or consxiL- 
tants' normal working hoxars per day 

Whether this length of tiitie is determined 
contractually 

Principal-respondent's hours per week on 
conp ed outside of regular working hours 

^^^pincipal-respondent's percent tin^ plan- 
ning carp ed • 

Principal-respondent's percent time plan- 
ning other 
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Principal-respondent's percent time train- 
ing Oil ccnp ed 

Principal-resondent's percent time train- 
ing in other 

Principal-respondent's percent time in 
cotp ed decisions 

Principal-respondent's percent time in 
other decisions 

Principal-respondent's percent time in 
ccnip ed administration 

Principal-respondent ' s percent time in 
other administration 

Principal-respondent's 'percent time in 
other activities- 

"Other Activity" listed 

Days of stxadent attendance intended for 
1974-75 sc1tx>1 year 

Additional days beyond students* included 
in teacher's agreement this year 

Additional days beyond students' included 
in principal -respondent's agreement or 
irxier standing this year 

Additional days beyond students' included 
^ paraprof essionals ' agreement or under- 
standing this year 

Additional days beyond students' included 
in reading or nath specialists' or 
consultants' agreement this year 

•Lenoth of typical school day for student, 
exclbding lunch 
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Miscellaneous Characteristics 



School enrollment r 1976-77, K-6, by grade 
and cccnbined 

Total cotp ed students, 1976-77^ K-6/by 
grade and conbined 

Number of regular classrocm teachers, - 
1976-77, K-6, by grade and coiDbined 

Number of regular' classroom teachers with 
ocnp ed students in classrxxxns, 1976-77, 
K-6, by grade and conbined 

Number of ccmp ed instructors, 1976-77, 
K-6, by grade and combined 

Full-time equivalent corrp ed instructors, 
1976-77, K-6, by grade and ccntbined 

Number of ccrnp ed paraprofessionals,^ 1976- 
77, K-6, by grade and conbined 



FullMzime equivalent carp ed paraprofes- 



Number of parents assisting school *s 
teachers without pay in coip ed this year 

Average hours per student of such assist^ 
ance ) 



school *s teachers without pay in camp ed 
this year 

Average hours' per student teachesr of such 
assistance 

"Number of student volunteers from other 
schools assisting school *s teachers with- 
out pay in com ed this year 

Average hours per student volunteer of 
such assistance 




bined 



Number of student 



teachers assisting 
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Nuober of non-student manbers of volunteer 
organizations assisting school's teachers 
without pay in conp ed this year 

Average hours per such volunteer of such 
assistance 

Nurttoer of members of service clubs assist- 
ing school's teachers without pay in cotp 
ed this year 

Av^age hours per such voliSmteer of such 
assistance 

Number of other cootnunity persons assisting 
school's teachers without pay in dtxrp ed 
this year 

Average hours per such volunteer of such 
assistance 
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* BEIATED TO A TEAOER IN A STUDY SCHOOL * 
Staff C3iaracteristics 

Whether the respondent is a specially hired 
cxxtp ed instructor or a regular classroon 
teacher 

Gender of respondent 

Respondent's age ^ 

' Respondent's total years qf classroon 
teaching .experience ^ 

Respondent's Jiigh^st degree level held 

Respondent's semester hours in courses 
specifically dealing with reading or math 
instmctioh . " * 

Type of specific training that has most 
increased -respondent ^'s effectiveness in 
' reading or itath instruction 

Respondent's 1976-77 annual salary 

Organization and Managensnt of Program 

Number of discussions with district's ccmp 
ed director in/last 12 months on reading 
or math activities of respondent's carp 
^ed students • 

Percent of such discussiojis initiated by 
the director 

Major .topic of such discussions with the 
director ' \ 

Number of visits by director tore^ndent^ 
classroom in last 12 months to observe \ 
reading or math activities of respondent's 
ccnp ed students • * ^ 

Whether the director typically provided 
feedback to respondent after such visits 
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Vihat was typically said or done by the 
director; i.e.^ feedback to the respondent 

Average nunt^er of discussions per month 
vdth principal in last 12 months on read- 
ing or math' activities of respondent's 
carp ed students 

Percent of such discussions initiated by 
the principal 

Major topic of such discussions with the 
principal 

Average nurnber of visits per month by 
principal to respondent classroom in last 
12 months to observe reading or math acti- 
vities of respondent's carp ed students 

\^ether. the principal typically provided 
feedback to respondent after suph visits 

What was typically said or done by the 
principal, i.e., feedback to the respondent 

Respondent's assessment of the effectiveness 
of the principal's support of respondent's 
conp ed reading or math activities 

Basis for judging this effectiveness 

Whether a non-cortp ed. reading or math -^'"^^ 
specialist or consultant is assi^ed to 
respondent's school 

Number of discussions with this person (s) 
in last 12 months on reading or math 
activities of respondent's ccmp ed students 

Percent of such discussions initiated by 
this person (s) 

Major topic of such discussions with this 
person (s) 

Number o& visits ^ by this person (s) ^o re- 
spondent's classroom in last 12 months to 
observe reading or math activities of 
reSDondent's ccnp ed students 
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VJhether this person (s) typically provided 
feedback to respondent after svch visits 

VJhat was typically said or done by this 
person (s); i.e., feedback to respondent 

Respondent's assessment of the effective- 
ness of this specialist's or consultant's 
sxipport of respondent ' s coctp ed reading 
or math activities 

Basis for judging this effectiveness 

Methcxi by which conp ed and regular teach- 
ers coordinate their reading or math acti- 
vities for carp ed students 

Respondent's satisfactionf with this coor- 
dination 

Basis for this assessment 

Ways in which coordination might be im- 
proved 

Manner in which respondent uses carp ed 
paraprofessionals in hisAer corrp ed read- 
ing or mth activities 

Percent of all testing programs involving 
respondent's coup ed students that prov^e 
test results, to respondent within oneY 
month of administration, (V 

Respondent's assessment of the degree of 
control teachers have over every day acti- 
vities in respondent's school 

Organization and Management of Class3^oocn 
Reading or Math Activities 

Whether the reading or math instruction 
provided by the respondent to comp ed stu 
dents is directly related to a set of 
'written product performance objectives 

Main source of perfornance objectives 
being used 

81- 
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Ihe individual or group towards vMch 
these performance objectives aje directed 

Fraction of parents of respondent's ccctp 
ed students who agree to assist respondent 
in their, children's reading or math 
emotivities when asked 

VJhat par^ts could dcf^ help • 

Re^xDndent's degree of involvement in the 
determination of which students would be 
provided comp ed assistance 

Meth od of Instrfiction 

' — ^ " ^ 

Percent of his/her conp ed students' time 
in reading Sr math activities pJ:wided by 
respondents they are proceeding at their 
individual pace 

Fraction of published reading or mth' 
nateri^isyus^l by respondent in conp ed 
reading or math^ctivities selected by 
respondent 

Whether cam>ercial\ texts are basic 
# (reading or imth) 

Whether ccninerciaf texts are supplementary 
(reading or math) 

Whether district or school-generated 
materials are basic (reading or math) ^ 

\^ether district or school-generated 
materials are supplementary (reading or 
math) 

\7hether imterials generated by respondent 
are basic (reading or math) 

^ ' ' ^Vhether imterials generated by respondent 

are supplementary (reading or math) 

Whether newspapers and other periodicals 
are^basic (reading or math) 
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VJhether newspapers and oth^ periodicals 
• . are supplatventary (reading or math) 

Whether motion pictures 'are basic (reading 
or math) ^ 

Whether motion pictures are supplemantary 
(reading or math) 

Whether film strips, slides, transparencies 
are basic (reading or math) 

Whether 'film strips, slides, transparencies 
are supplementary (reading or math) ^ * 

VJhether tape recordings and records are 
/ ^ basic (reading or math)^^ 

Whether tape recordings and records are 
supplonantary^ (reading or irath) 

Whether ElV telecasts are basiQ> (reading . 
or math) . * ' 

VJhether. ETV telecasts are supplementary 
(reading or math) 
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"Other Basic Materia^* (reading or math) 

^Other Supplementary Material" (reading 
or math) ^ 

Percent of conp ed reading or math time 
spent diagnosing 

Percent of carp ed reading or math time 
spent prescribing 

Percent of conp ed reading or math time 
spent in individualized instruction 

Percent of ccnp ed reading or math time 
spent providing feedback, to individual 
stixJents 
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Percent of ccxrp ed reading or nath tiire 
spent introducing new topics 

Percent of carp eS reading or math tine 
spent reviewing previous topics with the 
group 

Percent of carp ed reading or math tiire 
spent in disciplining 

Percent' of carp ed reading or math tiire 
spent in group reading . 

c 

Percent of carp ed reading or math time 
spent in other activities 

"Otller Activities" 

Description of feedback provided by 
respondent to individual ccnp ed stiidents 
in reading or nath ) 

Techniques or approaiches relied upon by 
respondent Treading or inath) 

VJhether grouping is used in carp ed reading 
or nath 

Basis used by respondent for grouping carp 
ed students for reading or irath 

Number of carp ed students per reading 'or 
iTiath group 

Whether snrall group is usually led by' a 
student 

Whether srrall group is usually led by a 
paraprofessional , 

Whether srrall group is 'ususally led by a ^ 
parent volunteer ' • ' 

Whether snail group is Usually led by 
another teacher 

Whether small group is usually led by a 
reading or nath con^^tant or specialist 

8^ 
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Whether small group is usually led by 
respondent 

VBiether' small group is usually led by 
other person not listed 

"Other person" leading snull group . 
instruction 

Time per day per carp ed reading or math 
grov5> 

Staff Developnent Specifically Related to 
CccTpensatory Education Reading or 
Math Activities 

Number of days of specifically related 
training provided respondent/ 1976-77 

Number of days of specifically related 
training provided respondent, cjatset of 
current ccxtp ed reading^ or nath program in 
school 

Major topic of "training session, 1976-77 

ffejor topic of .training session, outset 

Respondent's assessment of training 
effectiveness, 1976-77 ' 

Respondent's assessment of training 
effectiveness, ocitset 

Whether principal was i^ivolved in training, 
1976--77 

VJhether principal .was involved in training,! 
outset 

VJhether district's comp ed director was 
."involved in training, 1976^77 

VJhethfer director * was ^ involved ii) training , 
outset ^ - ' , ' 
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Whether training follow-up activities 
have occurred for the '1976*-77 tramlng 

Whether training follw-up activities h^ive 
occurred for the outset training 

Student Variables 

m 

Respondent's assessment-*of the level of 
difficulty of reading or mth iraterials 
used relative to cajp ed students 

Respondent's assessrrent of carp ed 
student motivation 

Respondent's assessment of conp ed student 
peer conpetitiveness 

Respondent's assessment of the degree to 
v^ch his ccnp ed students like school 

Percent of respondent's comp ed students 
expected by respondent to conplete high 
school • 

"Causes" for corrp ed students' perfornonce 
below expectations 

School and District Variables 

Respondent's assessment of teacher morale 
in school 

VJhy this is so ' ^ 

Utilization of Staff Time 

Minutes of reading or mth instruction per 
day per ccmp ed student in the regular 
classrocm 

Minutes of -reading or -math instruction per 
day per comp ed student in ,a sffecial 
classroom 
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Minutes of reading or math instruction 
per day per non'-conp ed student in the 
regular classroou^ 

Minutes of reading or math instiUction 
per day per non-ccrnp ed student in a 
special classrcxm 

Respondent's weekly hours of instructional 
contact teaching reading or irath to carp 
ed stxadents 

Respondent's. weekly hours of instructional 
contact teaching reading or inath to non- 
carp ed students 

Respondent's weekly hours of instructional 
contact for all other teaching activities 

Respondent's total weekly hours of 
instructional contact 

Respondent's total weekly hours of non- 
instructional student contact 

Respondent ' s hours per week oh cotip ed 
outside of regular working hours 

Respondent's percent of available time 
spent planning- comp ed 

Respondent's percent of available tiioe 
spent planning other 

Respondent's percent of available time 
spent training in ccrrp ed 

Respondent's percent of available time 
spent training in other ^ 

Respondent's percent of available time 
spent in coop ed decisions * 

Respondent's percent of-^i^xlable time 
''spent in all other decisions/^ 
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Respondent's percent of available time 
spent in administrative/record keeping 

Respondent's percent of available time 
spent^ in other activities 



Number of special CKXip ed reading or iteth 
teachers assisting respondent in ccnp ed 
reading or math 

Number of paraprofessionals assisting 
respondent in cccro ed re&ding or math 

Number of rvDn-cocnp ed reading or math 
specialists' or consultants assisting 
respondent J in camp ed reading or math 

Number of other persons assisting 
respondent in carp ed reading or math 

Number of students in classroon dtaring 
cotp ed reading or nath 

Number of carp ed students served by 
respondent (reading or math) 

^ Number of parents assisting respondent 
' without pay in.ccnp ed this year 

Average hours per parent of/ such 
assistaroce , * . 

Number of student teachers assisting 
respondent without pay in ccmp ed this 
•year' 4 

Average hours per student teacher of 
such assistance 



"Other Activity" listed 



Miscellaneous Characteristics 



Number of regular tochers assisting 
respordent in carp ed reading or 




Number of student volunteers* from other 
schools assisting respondent \vithout pay • 
in conp ed this year 

Average hours per student volunteer of such 
assistance 

Number of non-student menibers of volunteer 
organizations assisting respondent without 
pay in ccmp ed ,this year 

Average hours per such volianteer of such 
assistance 

Number of mortoers of service clubs 
assisting respondent without pay in carp 
ed this year 

Average hours per such volunteer of such 
assistance 

Number of other cxxmrunity persons 
assisting respondent without pay in carp 
ed this ye^r 

Average hours per suph volunteer of such 
assistance 
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^ * FEEATED TO A (XMP ED PARA- 
PROFESSIONAL m A STUDY SCHOOL* 

Staff Charac±eristics 

Gender.^ of resgjondent 

Respondent's age 

Whether respondent is currently wrkirig 
less than full time 

Respondent's highest level of forin^ 
education cxxpleted" ' 

Type -.of training that has itost strongly 
influenced respondent's conduct in oonp 
ed reading or math ^ 

VJhether respondent lives within area 
senved by school district 

Whether respondent has any,chil<3rer/ 

Whether respondent has any school age 
children 

Whether any of respondent's school age 
' (Children attend public 'school' in the 
district - • 

Respondent's 1976-77 annual salary 

Organization and ^^anagenent of Program 

Number of discussions with princiEal in , 
last 12 moijths on respondent's cxxrp ed 
reading or 'mth activities 

PercQit of such discussions initiated by 
the principal ' ^ 

Major topic of such discussions with the 
principal 

Method by v^iqh school* staff members 
coordinate their reading or math^ activities 
fpr optnp^ students ' ' 

00 
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Respondent's satisfac:±ion with the 
coordination 

Basis for this assessment 

N 

* 0 

Ways in which coordination might be 
iiT^JTOved 

M gani'7j:^tion and Managerient of Classrocm 
^ Reading or Math j^tivitie"s ~ 

^ - Wanner in which respondent's tine is' 
utilized in conp ed reading or irath 
^activities 

. tyfethod of Instructio n ] 

^ Whether respondent gives diagnostic tests 

' ^ Whether respondent tutors individual 

students ^ v 

Whether respondent leads small groups 6f 
students in a lesson ^ 
' ■ ' t 

Whether respondent plans student activities 
for the next day 

^ . Whethex respondent selects materials for 
individual students to fit a prescribed^" 
-lesson plan 

* 

^ Whether respondent prepares materials 
himself for use in corrp ed. reading or math 
activities 

'* Whether respondent maintains student 
' instr^ictional records 

' ' ' Staff Development Specifically Related to 
^ Conpensatory Education Reading or 
Math Activities 

Nuinber of days of specifically related 
trainings provided respondent, 1976-77 

Major topic of training sessions, 1976-77 
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Student Variables 

Percent of ccnp ed students respondent 
WDrks with expected by respondent* to 
(xnpleta high school v 

* School ai>d District Variables 

Respondent's assessment bf para- 
professional's morale in school 

- Why this is so 

Utilization of Staff Time 

Number of minutes each day respondent 
works with the typical conip ed student in 
reading or math • • 

Respondent's weekly hours o£ instructional 
contact ' in reading or math 

Respondent's^ weekly hours of instructional 
^ ^ contact in all other subject areas 

Respondent'' s total weekly hours of 
^ instnK:tional contact 

Respondent's total weekly hoiprs of non- 
instructional student contact 

^ " Respondent's hours^per week on conp ed 

outeide of regular working hours 

Respondent's percent of available time 
spent planning conp ed \ 

Respondent's percent of available time 
^ spent planning other 

Respondent *s percent of available time 
^ • spent training, in oonp ed • 

Respondent's percent of available time 

spent 'training in other 
* • * ' «• 

I ft 

Respondent's percent of available time* 
O • , spent in 'ccmp ed decisions 

-EEIC . .92. 



Respondent's percent of available tiine 
spent io other decision^ 
# 

Respondent's percent of available time 
spent in administrative/record keeping 

♦ 

Respondent's percent of available time 
spent in other activities 

"Other Activities" listed 

Miscellaneous Ch^acterjgtics 

Nuniber of ccnp ed students served by 
respondent (reading or math) 
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* RELATED TO OTHER INVOLVED STAFF 
IN STODY SCHOOL * 

Staf f ' Characteristics 

Respondent • s ^ title 

Respondent's 1976-77 anniial salary 

Cdrg^ization and Managernent of Program 

Role played by respondent in corrp ed 
reading or ^math at school 

Utilization of- Staff Tine 

Respondent's hours per week on conp ed 
outside of regular working ^hours 

Respondent's nornal vorking hours per day 

Respordent's working days per year 

Respondent's weekly hours of instriactional 
contact, teaching reading or math to ccmp 
ed students 
-v 

Respondoit's weekly hours of instructional 
contact teaching reading or math to non- 
ocnp ed students 

» 

Respondent's weekly hours of instructional 
contact for all other teaching activities 

Respondent's total weekly hours of ^ 
instructional contact 

Respondent's total weekly hours of .non- 
instructional student contact 

Respondent's percent of avail^lie time 
spetit' planning comp ed 

Respondent's percent -of available time ^ 
spent planning other • 

' ^ f 
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APPENDIX 5 
SAMPLING QUESTIONNAIRES- 



• Cover Letter . . 

% D\strict-Level Questionnaire 

% ^ School -Level Questionnaire t 




EXAMPLE FORM LETTER TO SUPERINTENDED IN ^ 
DISTRICT OPERATING A^^Om^ATEI> PRDGPAM 

Deal? r y>^^^^^.c^s^ 

The National Institute of Education '^(NIE) has been asked by Congress 
to corducfc a stidy of well-implatvented instructional programs in reading and 
itBth for conpensatory .education students. A major activity of this study to 
date has been tiie identification of potential programs for inclusion in the 
stuiy as examples of either well-implemented individualized programs or well- 
iirplemented standardized programs • Selected operational programs dioring the 
1976-77 school year' will provide the data base for tiug/^^^^S^^&i^a^ study' to 
^ subuitted prior to hearings on the extension of ESEA. \ 

information available to us has indicated that your .district is ' \ 
currently operating' progr^T\s v^iich should be considered in developing the 
final sanple for the study. Vfe have 'enclosed- a brief questionnaire vMch 
we. have partially filled out with the data already available to lis/ plus 
blanks for 'a number of other 'items we. need for our selection process. Please 
note that we are also interested in^ other quality' reading or math gpograms 
you are currentl]^ operating for ocrp ed stixients beyond' those we have al- 
ready listed in the attached form— 

if your district completes this form and returns it to us, you 
stould' realize that such action in no way caimits you to any further partici- 
pation in this study should one or more of your programs be selected as de- 
sirable inclusions in the san?)le to be developed. Such participation in the 
study would eventually involve some testing of selected students, the time 
of sane of your personnel (for completion of an instrument on program in?)le-- 
itentation) , and the limited observation of classroon instructional activities 



diiring the year. It ,sfeuld be nbted, however, that under no circumst^ces 
would participation in the study involve itanipulation of your students either 
through assignment to different classrocnts or through provision of any in- 
struction other than that provided by ycur district personnel. 

In return for participating in the study, your district's instructional 
personnel would receive all testing results for us^ in diagnostic activities 
for the 1977-78 schx>l year; and you would receive a copy of the results of 
the study fran NIE. ^All persons involved would receive the satisfaction of 
contributing to a cotprehensive effort to study the effectiveness of a mjor 
educational itovatient, the individualization of instruction for ccxctp ed stu- 
dents. 

Vfe^wDuld appreciate your forwarding ths enclosed questionnaice to the 
key administrator in your district who vrould be roost familiar with the scope 
and operating characteristics of the ocmpensatory education reading and math 
a<?tivities in your district, or you nay fill it out yourself. In any case, 
when caipleted, please return, the enclosed form to: 



We would appreciate a response within two 'weeks of the date you receive 

this letter, if at all possible. Please call me at ( , or _j 

of NIE at ( ) with any questions you may have regarding 



this request. 

Thank you for your assistance in this much needed effort. 
Sincerely, 



' (contractor) ffi 
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NIE -SPONSORED STUDY OF 
INDIVIDUALIZED INSTRUCTION 
FOR 

COMPENSATORY EDUCATION STUDENTS 



DISTRICT-LEVEL ADMINISTRATIVE QUESTIONNAIRE 



Please cxrnplete the enclosed itans . The (typei responses were available to us 
already; please cx)rrect any erroneoiis info^^tion you find axnong these typed 
responses. 

When conpleted, please return this form to: 



Call 



or 



of 
of 



NIE 



at i I 

at ( ) 



vd-th any questions. 
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Name of School District: [Typed] 

Address of School District Administrative Offices: 
- , [Typed] 



Respondent's Name: • [Typed] 

Respondent's Phone Number: ( ) 

Respondent's Position: - 



(a) Defining a "ccmpensatory education stijdent" as one v*o is eligible 
for ESEA Title; X assistance, vAiether such assistance is available 
or not, hw many grade 2 classroccns are there in your district 
containing at least six conpensatory education students? 

grade 2 classrooms vd.th at least 6 conp ed stvdents 

(b) How about grac3e 3? 

grade 3 classrooms vdth at least 6 carp ed students . 

(a) In how many of the above grade 2 classrooms are the ccmp ed students 

receiving specific supplementary reading instruction? 

of the above grade 2 classrooms with si:5:)plem9ntary * 

comp ed reading 



(b) In hew many, math? 



of the above grade 2 classrocms with supplementary 
conp ed math ^ 



(c) In how many, both reading and math? 



of the above grade 2 classrocms with both supplementary 
conp ed reading and sufplementary ccnp ed math 
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8, (a) In hDw many of the above grade classrcxxns are the ccmp ed students 
. receiving specific siipplanentary reading instruction? 

of the above grade 3 classroons with suppl(3T>entary 

corrp ed reading 

(b) In how n^Y; irath? • ^' , - 

of the above grade 3 classrooris with supplei^entary 

COTp ed ruath 



(c) In how n^y, both reading and nath? 

of the above grade 3 classrooms with both suppleT^tary 

carp ed reading and supplen^ntary coip ed mth 

9. How n^y students are currently served in your district (1975-76 
school year, K-12)? ' ' ^ ' 

* • stiK3ents 

10. Of the above total, hou' many students are corrpensatory education students'^ 

Students 

11- Table 1 belo-v lists a nunter ,of reading progranis in your district Uvit 
have been suggested to us as examples of quality educational prograins 
for ccrpensatory educaticin^^tiidents. We are particularly interested in 
such prograins as they opetate for these students of the second and third 

grade levels. We are alsji' interested in any additional reading programs 

■ / 

your district operates fiot cxisipensatory education students at these grade 

' . < i * > 

levels that you feel should be included in our considerations. For the 

programs we have nah^;^j,^j>^us any others you might suggest, please provide 

the following data- in tl^ column of Table 1 indicated below: 

Column / : Name of the program; already entered for those programs 

already suggested to us, please add your own suggestions 

in the spaces provided. 
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Colurnn U In how many of t±ie already mentioned grade 2 classrooms 

whose carp ed students are provided specific supplen^tary 
instruction is this program used for this specific 
supplementary instruction? 

column 3: Same question as Column 1 but for the grade v 3 classroons 
already mentipned, ^ * 

Column 4: In how nnny of the gr^de 2 classrooms included in Column 2 
is the supplQTientary comp ed instruction provided in a 
classroom settina which physically separates the comp ed 
student frcni their non-ccOTp ed classmates (e-g., in a 
1 separate reading center)? 1 



GcluTni'i Q 



the grade 3 classrocxiis 



Column 5: Same question as Column 4 but for 
included in Column 3. 

Enter tile letcer (A, B, (J, Or D) corresponding to the statesrvent 
listed below which best describes your assessnent of the 
effectiveness of the program named in Column / in improving 
.the skills of grade 2 and grade 3 cbmp ed students and the 



'ating according to your 



degree to which this program is opei 
understanding of the overall designior reccnmended educational 
plan for that program: " • 

A) Tlie program is effective and 'operating according to my • 
understanding of its plan, ^ 

B) The program is effective but. could be ixnproved further 
by operating it more in accord with my understanding of 
its plan. 
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Coluran 6: (Continued) 

c) The program is operating in accord with my understanding 

of its pl^ but is not effective. 
D) The program is neither effective nor operating according 
^to my understanding of its plan. 

Column 7 : For how rmny school years had the program named in Column / 
been in operation in your district through the end of the 
1974-75 schcxDl year at grade levels 2 and 3? 

Column S : In how n^y of the classroons included in Colannn 2 do you . 

anticipate continuation of this program without mjor changes 
during the 1976-77 school year? If najor changes are expected 
at this grade level for the 1976-77 school year, please 
describe them in the space provided for coments at the 
bottom of Tcible 1. 

Column 9: Same question as Column S but for the grade 3 classrooms 
included in Column 3. 



In Columns 10, 11, 7 2, J 3, and M please respond- "yes'' or "no*' to the 
question associated below with that column. 



Column 10: TVre specific written perfonrance objectives assigned to each 
, ^ second and third grade conp ed student in the prograrrt named, 
-ifi Column' 1? ^ 
Column 11: Is the following statar^nt true*in its entirety? 

''Initial placement for each second and third grade carp ed 
student in the rmterials of the program named in Column 1 is 
iDased on a diagnostic test, and a specific process is subsequently 
folla-ved for diagnosing student needs and assigning prescriptive 
'imterials or exercises on a continuing b^sis." 
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Column J 2: Ar^ uniquely prescribed individual learner paths through the 
relevant program naterials followed by each second cind third 
grade^^etSrp ed student in the program nanrved in Column /? 

Column /3: Is the following stateirent true in its entirety? 

"The cjrtxDunt of tiine required for any given second or third 
' grade ^^p ed student in the program named in Column / to raster 
a specific performance objective or t:o ccnplete a given 
portion of the program's materials is determined individually 
for or by that student and varies from student to student . " 

Column /4: Are t±iere written curriculum guides, teacher lesson guides 

^ ' ♦ ' 

or any other docunxBntation available in your district indicating 
either the suggested educational plan for Oi>3rating the 
program naiT>ed in Column I or district-level or schooI^-level 
mandates regarding the operations of this program? 
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Table 2 below lists a number of math progranis in your district that . 
have been suggested to us as examples of quality educational programs 
for ccmpensatory education students. As for the reading programs listed 
in Table 1, we are j^rticularly interested in such programs as they 
operate for these students at tlie second and third grade levels, we are 
also interested in any additional mth programs your district operates • 
for cxxnpensatory education -students .at "these grade levels 'tAaf you feel 
should be inoluded in our considerations. For -the programs wp have - 
named, plus any others you niight suggest, please prpvide the data 
indicated iij Table 2. Columns /'through U of Table' 2 corirespond exactly 

t 

to the respective columns of Table 1. j 
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Vfould your district be willing to participate in a national study during 
the 1976-77, school year requiring the testing of some students, on-site 
obsetvations of classrocm and administrative activities, conpletion of. 
^survey instrunients , and the forwarding of existing public data related 
to the programs and scrne of the classrooms in your district described 
/in Tables 1 and, 2? ' . • 

[ ] Yes . ' ' 

[ ] No 

[ ] . Need more infortTBtibn (specify kin/ of infornstion needed) 



/ 
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NIE-SP0NS0R13D' STUDY OF' . ■ 

INDIVIDUALIZED INSTRUCTION 
FOR 

COMPENSATOR\^DUCATION STUDENTS 
SCHOOL-LEVEL ADMINISTRATIVE QUESTIONNAIRE 



Please canplete tlie enclosed items. The typed responses were available to us 
already; please correct any erroneous infom^tion you find among these typed 
responses. 

completed, please return this fom to: 



Call 
'or 



with any questions. 
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!• Name-of School District: 

2. Name of School: 

3, School Address: 



[Typed] 



[Typed] 



[Typed] 



4, 

0 
5^ 



8, 



"School Phone Number: 
Respondent's Nan>e: 



) [Typed] 



[Typed] 



Respondent's Position: 



(a) Defining a '*canpensatory education student" as one vjbo is eligible* 
for ESEA Title I assistance, v^ether such assistance is available^ 
or not, how luany grade 2 classroc^-are there in your building 
containing at least 6 coirpensatory education students? 

grade 2 classrooins with at least 6 ccnp ed sttiSents 

(b) Hc^V' about grade 3? ' 

^ grade 3 classroons wio^at least 6 comp od students 

(a) In how nany of the above grade 2 clasS?)aTis arc the carp ed students 
receiving specific supplementary reading ins truest ion? 



of the above grade 2 classrooms with supplementary 
cotp ed reading 



(b)' In how many, math? 



of the above grade 2 classroons with supplenentary 
carp ed math ' ^ * 



(c) In how many, both reading and nath? 



of the above grade 2 classrooms with both supplementary 
coinp cd reading and supplementary carp ed math 
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(a) In how niany of the above grade 3 classr6ai[is are. the. carp ed students 

receiving specific supplenBntary reading instruction? 

f ^ of' the above grade 3. classrooms with supplementary 

cxxrp ed reading 

^'tb) In how many, math?^ 

^ ^ of the above grade 3 classrooms with supplementary 

carp ed na th 



(c) In hcwiflSffiy^ both reading and math? 

;>/ of the above grade 3 classroons with both supplen^entary 

\ carp ed reading and suppleinent^ conp ed rtath 

H6w nany students are currently served in your district (1975-76 

school year)? 

students » ' - 

.Of the above total, how n\any students are conpensatory education 
srudencs? 

students 

\vhat percent of your current student body speaks English as their 
native language? 

% 

What percent of your current student body - is non-minority? 
% 

Table 1 belai; lists reading and math programs in your school that have 
been suggested to us as examples of quality educational programs for 
coTpensatory education students. We are particularly interested in these 
programs as they operate for those students at the second and third grade 
levels. We are also interested in any additional reading and/or mth 
programs your school operates for conpensatory education students at 
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these grade levels that you feel' should be included in our consideration. 

prograiiis we have named, plus ahy othets you might suggest,' 
please provide the following data in the column of Table 1 indicated , 
•below. 

Column I : Naine of reading or math program; already entered for those 

programs already suggested to us, please add your own suggestions 
in the spaces provided* ^ 
' Column 2: In how many ^ of the already nientioned grade 2 classrooms whose ' 
carp ed students are provided specific supplementary reading 
or math instruction is the program named in Column / used for 
this specific suppleiT>entary instruction? 
Column 3: Same question as Colimm 2 but for the grade 3 classrooms 

already mentioned." 
Column 4: In how many of the grade 2 classrooiis included in Column 2 
is the supplementary conp ed instruction provided in a 
classroan setting which physically separates the conp ed 
Students frcxn their non-ccnp ed classrrBtes (e.g., in a separate 
learning center)? 
Column 5: Same question as Column 4 but for the graSe 3 classrooiis 

included in Cbluinn 3. 
Column 6: Enter the letter ,(A, B, C, or D) corresponding to the statcrr^nt ^ 
listed below v^ich best describes your assessment of the 
effectiveness of the programs named in Column / in inproving 
. the reading or math skills of grade 2 and grade 3 carp ed 
students and the degree to which these programs aire operating 
according .to your understanding of the overall design or 
recontnended educational plan for that program: 
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14.^ Column 6: (Continued) 

A) The program is effective and operating according to my 
^ understanding of its plan, * ^ 

B) The program is effective but .could be aji?)roved further 
by operating it more dn accord with my understa;x3ing of 

/ the plan, 

CT The program is operating in accorji with my understanding 
'of its plan but is not; effective, 
^ D) The program is neither effective nor operating according 
tp my understanding of its plan. 
Column 7 : For how nany school years had each program named in Cblumn 7 
been in operation in your school through the end of the 
1974-75 school year at grade levels 2 and 3? 
Column S : In how many of the classrooms included in Column 2 do you 

anticipate continuation of the program without major changes 
during the 1976-77 school year? If imjor changes are axpected 
at this grade level for the 1976-77 school year, please 
describe these in tte space provided for concnents at the 
bottm of the table. ^ 
Column 9: Same question as Column i but for the grade 3 classrooms 
included in Column 3. . 



In Columns 7 0, 7/; /2, 73, and /4 please respond "y^s'' or "no" to the 
question associated with that column^ 



Colvpnn /O: TVre specific written performance objectives assigned to each 
second and third grade corrp^ed student in the program named ^ 
in Column I? ' ' * ' . ' 
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14 • Column JJ : is the following Statement true in its entirety? 

"Initial placai^ent for each second and third grade conp ed 
student in the materials of the program named in Column / 
is based on a diagnostic test, and a specific process is 
subsequently follds^ for diagnosing student needs and, 
assigning prescriptive materials or exercises on a ' * 
•* continuing basis*" . - ' 

Column / 2 : Are* uniquely prescribed' individual leafner paths through the 
relevant- program materials followed by each second and third 
grade coTTp ed student in the program named in Column J? 

oilumn 13: .Is the following statemertt true in its entirety? 

"The aTOunt of time required for any given second or thirh 
grade carp ed studei'^t 'in the program ' n£5ned in CiDluinn I 
^ ' to master a i^pecific perfonrance objective or to caqDlcte a 
given portion of the program's raterials is determined for 
or by that student and varies f^rom student to student."' 

Col.umn ]hx Are there^ written curricular guidea, teacher lesson guides, 
or any other documentation available in your schodl 
^ indicating either -the suggested educational plan for operating 
the program named in Column / or district-level or school- 
level niandates regarding the operation of this program? 
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Table 2 below again lists the programs named in Table 1 (add the prograns 
you suggested in Table 1 in this Table as well) . For 'the pix>grams we have 
named, plus the others you nay have suggested, please provide the 
following data in the column 'of Table 2 indicated below: 
Column Name of program; should inatch names in Column / of Table 1. 
Column 2 : Please list the naines of your current grade 2 and grade 3 

teachers providing instruction in reading or nath respectively 
' ^ . to the grade 2 and grade 3 ccmp ed students in the program ^ . 



listed in Column'/, 



Column 3 : For each teacher listed, in Column 2 , shav the approxiittete 

percent of that person's' salary provided from state or Federal 
^ compensatory education funds (e.g., a teach^r_p^id"tote 
from local funds \voiild show a "0%"*; one paid totally fran 
ESEA Title I funds, a '•100%"). , " . 

Column 4: Place a check (>/) ne>ct to each person' listed who, under 

current plans, will be involved in the same program next year 
at your school. 

Column' 5: Place a check (v/) next to each person listed whose next 

year's class assignnient, if known or estimable at this time, 
will include at least 6 comp ed students with at least 3 of ^ 
these conp ed stqdents ne-^^ to the program at that tima and at 
least 3 who were in the program this year. If your plans are 
not specific enough at this time to allow you to respond" in 
this column, please enter "unknown". 
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What percent of your school's current enrollment are assigned to your 
school for the 1975-76 school year as a result of a mjor student re-^ 
distribution (e.g., the closing of another;^ elaiientary 5ciKx>i~ dye to 
declining enrollments or„ a redistributipfi to fulfill a desegregation plan) 
since 1 Septenter 1974? 

'^^^ percent 

Are there other schools in your district \^th Title I eligible students 

similar to yours which use the same prograiVmaterials? 

Heading - Math 
" — — — ^ 

[ ] [ ] Yes 

. [ ] f ] "No ' 

[ ] [ } .'Don't know 

If so, please name those schools (ILTdting your answer, to blTtree otliers 
is adequate) : \ 
Reading 



Math 



Would your school be willing to participate in a national study during the 
197^-77 school year requiring\the testing of sorne students, on-site 
observation of classroom and administrative activities, coirpletion of suirvey 
instruments, and the forwarding of\^xisting public data related to the 
^rogramg and some of\\l3e classrooms in your school described in Tables 1 and 2? 
{ ) Yes ' ^ • 

[ ] Need more Inforrnation .(specify kind of information needed) 
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SAMPLR SIZE DHTERMINLMION 



In general for any given statistical procedure, the choice of sajnple sizes 
is related to: (I) significance level, (2) magnitude of the error variance, 
(3) "effect size*' which it is desired to detect, and (4) type II error rate 
which is deaned satisfactory for the specified effect size* In a c<^plex study 
with several levels, of statistical analysis, it is necessary to base decisions 
concerning sa^iiple sizes on several simplifying assumptions* UTien data are^ to 
be analyzed with aggregation of cases at different levels, it is appropriate ' 
to. consider the power of statistical tests under the least favorable conditions; 
•this^ results in a lower-bound detemination of sample sizes. In the present 
study, the least favorable comparison (from a power point of view) would involve 
a univariate V test between two independent groups selected from the 16 cells 
which are defined by the basic sajnpling plan (i.e., there are 4 tyj^es ot programs 
with respect to degree pf individualization; ^2 subject-matter areas - reading 
and arithmetic; and 2 delivery systems - mainstream and pull-out). Thus, sajiiple 
size determination reduces to a relatively , simple problem based on a two-gi'oup 
comparison. However,, an additional conplc'xity, is^inti^duccd by the fact that 
group means will^/be utilized as the basic unit of analysis. Since the. analyses 
will be based on mean scores, the apjpropriate error variance is that associated 
with' a mean, not the variance of individual scores. Further, since sampling 
will be from intact classrooms, the scores entering into a mean-, value cannot 
reasonably be , considered to be independent, thus invalidating the usual 
reduction in error variajice by a factor of 1/n for means based on n scores.' 
In the following paragraphs there is a development of the neces$ary formula- 
to properly adjust the error variance and an application of this fomula to the 
problem of sample size detemiination. ' . 



A- Tlic Error Variance for Correlated Scores 

In n scores are '^randomly selected ai^d fomied into a mean score, the 

sampling variance of the \ean will beo-Vn'if tlie' scores are independent with 

constant variance, o-^. UTien the scores represent a "cluster" dt is reas6nable 

\ ■ 

to assume ^hat the error variance observed in a sample will be artificially 
reduced because of induced honiogencity resulting from the influence of, the ^ 
"cluster" (i.e., achievement scores from students, within a single classroom 
may be more alike because^ of their common classroom experiences than scores of •■ 
students randomly selected from different classrooms). The degree of induced . 
homogeneity may be indexed by the coefficient of i ntraclass correlation (i.e., 
the expected correlation between scores from pairs of students within a single 
classroom cluster). Xotc that under independent random sampling, the intraclass 
correlation coefficient is expected to be 0. If we let p roprcspnt this intra- 
class coefi'icicnt, it is Oasy to show^- that the variance ot a" mean score based 
on, a cluster of size n is (c2/n).-[l + (n-I);-] , where the factor (n-1),'^ is, in 
^effect, an-adjustifient for the artificially Vow variance foiuid within clusters'. 

Ilxe influence of an. intraclass corrclat\on on the magnitude of the 
sampling variance of a^mean can be substantial, especially for moderate to 
large values of P . For example, assimiing <r = 1 for simplicity, forr= .3, 
the variance is .44 for sqjnples of size 5 and .37 -for, sajnples of .size 10, as 
compared to' values of .20 and .10, respectively, \^ien the scores are 
independent {p= 0). Further, for P= .5, the corresponding variances are .60 



See W. E. Doming, Som? Th cor)^ of Srmipling. Wiley, 1950, page 194 eq. 65; in 
Doming s notation, set m = 1 and \' = n to derive the following expres'^ion 
For a direct derivation, ict T^^,. be the expected cov.^riance between tuo scores 
within a cluster; then, the variance of n scores is j^/n + <r .,n/(n-l). 

V A.ssumihg homogeneity, P = '^yy^/o^ and substitution yields the^eauation as 
given in the text above. • 
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and .55; even for large sajnple sizes, the variance cannot be reduced below 

as a lijniting value (uiilikc independent sainpling/here the limiting value 
of tHte variance is 0 for large samples) . 

'Bj Establishing Effective Effect Sizes 

For the t^vo-sainple t test, J. Cof^en /n Statistical Power Analysis for 
the -Behavioral Sciences (Academic Press, 19B9) presents a ratipnale' (p. Z4) 
for the definition of a '^medium'' effect iize as^comprising a .5' standard 
deviation difference between two population means. Such a 'difference would, 
in correlation tems, account for approximately 6% of criterion score variance 
^and is, intuitively, a reasonabA^ value fc^fT^K minimum difference which would 
have educational implications, (Cohen's ^'smalri^^^fedt si:e is only .2 and, in 
correlation tems, account/ for about 1' of the criterion variance; such a small 
relationship is unlikely to have substantive educational implications). However, 
this efiffcct size is 4iTOc/tly applicable to samples based on independent scores 
and not to analysc/^^ased on means as the imit of analysis\ Thus, before 
utilizing Cohen' ^ tables for detennining an appropriate ininimun sajiiple size, 
it is nec(^ssar>' to convert the ^'medium*' difference of .5 standard deviation 
units into an *'ef fcctive'* effect size which applies to classroo-n mean scores. 
Vor exajiiple, with mean scores based on, say, independent scores, the sampling' 
variance of a mean would be only .20 and the effect size of .5 becomes an 
effective effect size 1.12. However with the more reasonable assumption of 
a positive intraclass correlation, tktB- effective effect si^e becomes only 
. .75 withp = .3 and .65 with p =^ .5. Using such »»effective*' effect sizes, 
the following table of Sample sizes for each group was constructed by inter- 
polating inCohen\s Table i,4.1 (pp. 52-53) for various ilzed clusters (classroom 
sampling groups) and for power of .7, .8, and .9. ' * ' * 



n=3 ' 'n=5 " n=6 \' n=7 n=10 ^ 

POWER*, 0 .3 .5^ 0 .3 .5 Q~3 TsV 0 .3 .5 0 .3 .5 

..70 18 28 34 11 23 31 10 -22 31 \8 21 30 6 19. '29 

• 80 • 23 36 44.14 30 39 12 29 39 10 27 '38*^ 8 '75 37_^ 

.90 ' 30 47 58 18 39 52 16^37 . 51 14 35 50. 10 33 49 

, For purposes of 'a final selection for the sample size per sjoup (i.e., 

for ^ach of the 16 design cells referreci to earlier) , reasonable estimates must 

be made for the expected number jof students which will be s'ampled within a 

given classroom (and such estimates may diffqr for ma ins t ream and pull-out ^ ^ 

programs). Also, the values for power and for the intraclass correlation'^iist 

be specified. A highly conservative approach would be to as^ae relatively 

small values for n for mainstre^im programs (e.g., n = 6), slightly larger value 

ot n for pull-out prograjns (e.g., n (==.10), a large value for (e.g. , .5), and 

demand a high le\trl of power (e.g., .90). for this caso-^ each maiio^tream grpup 

woultkxe^ire a sample of 51 classrooms and Oach pull-out group a saJTijUe of 19 

clas5rooms,\or a total sample of 800 classrooms (beforc-allouances for ovtfr- 

sampling), A more moderate choice oj values might use the same Values, for the 

mainstreajti and pull-out n value, f= .3, but with power Still set at^-a high level, 

« 

.90. Tlie resulting sample size per group is 37 for each mainstream program and 
33 for each pullout, or a total of 560 classrooms. A. final decision on sample 
size detemination must weigh the factors ^f power, size of clusters, arid 
expected intraclass correlation against the practical limits imposed by' 
temporal and monetary- conditions surj'ounding the data collection effort. T 
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SELECTION PROCESS FOR POTEOTIAL CANDIDATE SITES 
APPRQ?^H 

Identifying, selecting, and matching potential, candidate sites to ' 
the classification matrix criteria, required examination of hundreds of docu- 
ments. The-* initial process included identifying school districts which had 
reliable docamentation already on file in^ various federal program offices. 
This activity was especially crucial in that the initial selection process 
had to rely upon information sources currently in existence since surveys 
could not be conducted witl^ sites without O-MB clearance. Contact was rade 
with, federal program offices v^ch provided access to their project files 
for review of documentation of well-impleiiented individualized instructional 
programs in reading and nathennatics. Program officers provided additional 
inforrr^tion and greatly assisted ih narrowing down tl^e field of potential 

-.-i-^ x.vv^^^vwi^ v.*ocuiciiuciLj.uii ±n tne program of rices ot flight To 

Read, Follow Through, LSEA Title I, ESEA Title III, ard DRP files were 
examined. 

Over 20 mjor corrmercial publishers of individualized learning sys- 
tems v«re request^ to Txminate five schcx)l districts which, in their estima- 
tion, were implenenting their program in the most effective manner. In 
add'ition, TURIUCEY review^ its own files of approxinately 100 sctool districts 
to' identify additional sites meeting the selection criteria. 

The actual process of dofermining the specific characteristics of 
projects and identifying whether or not they should be considered potential 
candidate sites relied 'upon the use of a TURI^y^eveloped checklist (dis- 
played in Appendix. 9) . this checklist was applied to all projects review^ 
in federal program offices and in TURNKEY files m order to provide a pre- 
limimry indication of tl« availability of "lilcely" cardidate sites. After 
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finalizing the classification rratrix the checklist was revised* V^i^splayed in 
Appendix 10) and used to finalize the identification of potential candidate 
sites. Tlfe revised checklist focused upon nore specific selection criteria 
and was also used to develop a Keysort card filing systeiri for future^ re fer-- 
ence and consideration in model application. 

Available docunventation for conpletion of at least 50% of the check- 
list iteius was a major requiren^nt. Projects with files con1;aining less 
documentation w^re discarded and received no fiirther consideration. 

The revised checklist focused upon the four^ classification matrix 
criteria, i*e. , performance objectives, diagnosis and prescription, alter- 
native learning paths, and pacing. It also provided for identification of 
disqualifying criteria (when available) including numbers of scixx^l buildings 
utilizing progxuiVi, yraJes in which program is operating., numbers of available 
classroans, and the subject matter empliasis. , ' - ' 

Application of tl^e revised cf:tecklist to materials of -COTmercial pvib- 
lisherfe utilized similar procedures and included an examination of additional 
materials purchased by outside groups. These groups incluie organizations 
wJiich conronly critique such mat^ials tfor scIxxdI 'district decision-makers 
planning new programs (e.g., evaluators, EPIE) . " These critique rmterials 
provided additional insight into the actual operational characteristics of 
coTtnercial programs and further assisted in the dientification of potential 
candidate sites. In several instances it was necessary to examine actual 
instructional materials and teacher manuals provided by publisters to verify 
certain aspects of a systera for characteristics claimed by the publisher ♦ 
The numerous materials and liberal us of jargon plirases contribiited to the 
difficulties in these particulcir instances. 

Follow-up discussions vsere undert^lken to con^^lete or verify seme 
checklist items for a majority of the programs examined. Discussions with 



persons responsible for or knowledgeable about tlie program documentation 
being reviev,^ enabled project team xr^±ers to finalize the checklist for 
selection of potential candidate sites arxi assign classification matrix 
positions. . SchDol districts meeting criteria, for boxes numbered 1,2,3,5, ^ 
anrJ 9 in'fche matrix ^re centered potential candidate sites .for individu-. 
alized prc^ams. School' districts n>eetihg criteria for boxes numbered 8, 
12,14,15, and 16 will be considered potential candidate sites for standardized 
programs. • All sites which colild not be assigi^ed one of these positions in 
the classification itHtrix were discarded unless it was believed that additional 
ijiformation might alter their imtri^ position. In these instances tl>9 check- 
lists and related documentation vfere filed for possible reconsideration "at ' 
seme future date. 

Problems encountered in identifying potential candidate sites were 
of varying seriousness to study team iW2rnbers and contributed to the airount. ' 

j.-,^^ ^ una ^itc:t^/j.i:,c rratericij.s. tour rrajor situations 

re-occurred any nurtser of times: 

1. Persons knowledgeable about a ==i>9cific program u^'re not re?.dily 
available. They vA-re on leave, on sabbatical, or a less know- 
ledgeable person ted to he dealt with until their limited ariounT: 
of ijifonpation was exhausted and it was finally -dets-iied appropriate 
to inform the person who stould havti been .informed of what -was 
going on £rom the beginning. ' '' - 

2. Program officials were reluctant to identify the "best" or most 
^ IL "^vell-ii.plernented" programs. They wuld rather state that all ' 

of their programs wore good and it wDuld be difficult to single 
'out any one in particular. Referrals v^re often forttea-aing to 
consult with other layers of the bureaucracy first. Hovsever, 
after the TURNKEY study team waded "tlirough the files and identi- ' 

♦ V 
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f ied a number of apparently apgjropriate 'programs tJiQ^roject 
officer gladly ca.rented on tlieir cxDndition and was more 'than > 
willing £0 indicate vhich prograins were 'Wll-^iirplenented" ; 
3. Program office files were generally in various stages or organiza- 
tion for the purposes of the study team and materials usually, 
« could not ^ be. examined on an individual basis without assistance 
from clerical personnel . Ddcurrxsnts were often misf iled ^ left 
in a large contaijier- to "be filed" at a later date. Often the 
project members had pertinent documents in their offi^s'wtiich 
had to be found on an individual site-by-site basis. 
4., '-^l5evelopers ' and/or publishers' key staff were usually "in the 

field" and not readily available for consul tation, on identifying" "~ 
vvell-ijTplemented programs.. Procedures required to rruke contact 
were burdenscnie and generally involved 
administrative responsibility before serious discussions- could 
ensue. Several publishers deferred nonination information to 
regional managers \vho had to submit to corporate'headguarters which 
^ would actually release the information. The resulting quality 
of infontiation v/as many tinies over-burdening and required 
considerable time to review and sift to determine actual program 
characterist^ics. (Many publishers, howe\|er, \]^e extranely 
helpful in supplying very specific inforrration and focusing on 
well-implemented program sites irrniediately. ) 

RESULTS OF SELECTION PROCESS ACTIVITIES 

Study team members examined available documentation on the instructional' 

program^ of as many of tly- potential candidate, sites displayed in Appendix 8 

i * - 
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as tinie allow, ^ Application of the checklist displayed in^'Appendix 10 • 

and subsequent transfer of checklist data on eligible projects to Keysort 
(edge punched) cards resulted in the establishrtent^of a preliininary data 
bank for future reference. (One corplete set of tlie punched Keysort cards, 
indexes, and sorting "instrTactions are provided with this report under 

separate cover.) 

* » 

The examination of docunBntation on instructional prograins noting 
classification niatrix criteria resulted in the identification of 119 separate 
projects in 71 local school districts which can be positioned in the nadrix. 
The final listing of candidate sites develibped within tli6 study period is 
displayed at tHe epd of this appendix* The listing includes candidate iites 
fron federal programs of Ilight-to-Read , Follow Through,- ESEA Title' I, I 
ESEA. Title III, and GE Dissenination Review Panel; files as wjsll as 
reconrendations froni corrrvefcial publishers and s^Wted projects from | 
TUK.^n<EY files. . \ ^ ' . I ' 

The classification rratrix criteria for individual izeji and stand^dized 
instructional ^programs into wiiich the; 119 prog^a^ns Vvere categorized are^ '^ 
follows (the reader should keep in'niind tliat sane^ sites had rrore tlian one 
program meetJLn^ selection criteria reqUir'anents) : 
\ ' Matrix Classification I^x ^ Nunfoer of Programs - . 

1 ' 31 

. (Well-implen^ntod 2 • ^ - 7 

Individualized 3'- , 21 

Programs) 5 * 14 

_ ^ - ' * ^ ' 12 . 

8 5 ' . ^ 

(Vfell-implesrented • 12 ^ 11 

Stand^dized 14 . -4 

Programs) ^ 15 - 6 ^ ' 

: . ^ ' - 128. • 



The geographic distxihution of the 71 separate local School districts 
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with iastructional progrartis meeting classification matrix criteria is shown 

on the display- on the following page, ^ 
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CAiroimTE SITES \nmi individualized aid/or STA20ARDIZED PROGBAMS 

(VERIFIED) 





SITE 


PxCLXjlHAi 1(b) 


CLASSIFIC\TiaNI !'IATRIX CRITERJA 
P/0 D/P ALP PACE 


MATRIX 
BDDCK 


• 1 


Rochester , NY 


Read 










16 






Math 


+ 


+ 


+ • 


+ 


1 


* - O 

z 


Manchester, NH 


Read 




X 

T 


T 




1 , . 


: 3 


^ Longiiont, CO 


V 

. Read 


T 


T 






5 


Math 


+ 


+ /■ 


+ 




5 


S A 


Kansas City, I'D 


Read 


1 

T 


1 

+ 


1 

+ 


1 


1 ' 






I-lath 


+ 


+ 


+ 


+ 


1 


5 


Darlington, SC 


Rear! 


1 

T 


1 

T 


1 

T 




5 


6 


Santa Fe, NM 


Read 


- 


- 


- 


- 


16 






Math 










16 


T 


Portland, OR 


Read,' * 




1 

T 




1 


3 , 






Math* 








+ 


3 


8 


r 

Milwaukee, \XL 


Read ^ " 


T 




T 


1 

T 


2 


9 


Dallas, TX 


Read 




+ 


+ 


+ 


3 










T 




a. 

T 


3 


16 ' 


De^ i^ioines, lA 


Read 


+ 




- 


— 


14 






Math 


1 








14 


11. 


Okalcx)sa Co. , FL 


Read 


+ 


+ 




+ 


9 






I4ath 


+ 


+ 




+ 


9 


12 


Pontiac, MI 


Read 


+ 


+ 


+ 


^ + 


1* 


13 


Sdn Antonio, TX 


Read 


+ 


+ 


+ 




5 






?4ath " 


+ 


+ 


+ 




5 


14 


Aurora, IL 


Read 


+ 


+ 


+ 




5 






f>Iath 




+ 






5 


15 


Phoenix, AZ 


Read 




+ 


+ 


+ 


3 






Math 




+ 


+ 


+ 


3 


• ,16 


Kansas City> VO 


Read 








+ 


12 






Math 










12 
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CANDIDATE SITES TOTH INDIVIDUALIZED AITO/OR STAM^iRDIZED ^ROgHmS (Cont'd) 

(VERIFIED) ^ ■ _J. ' 



TJQCmEiTr CIASSJFICATION ^TRIX CRITERIA MATRIX , 



ID NO. 


~ SITE ■ 


PROGRAM (S) 


P/0 "-^ 


'D/P 


ALP 


PACE 




17 ■ 


Fairfax Co. , VA 


Read 


- 


+ 


- 






18 


Waterloo, Java 


Read 






- 


+ 


9 






Math 




+ 




+ 


9 


• 


• 














19 


St, Paul, iMN 


Read 


- 


- 




+ 


12- 


20 


Racine, m 


Read 








+ 


12. 






Math 




- 


- 


+ 


12 


21 


Las Vegas, M 


Read 










• 14 






Math 




mtm * 


- 




14 ■• 


22 


•PortsiTiouth, RI 


Read 








+ 


2 




Pniiaaeipnia, PA 


Read 










■ 8 




(EDC) 


Math 


- 




+ 


- 


8 


24 


Philadelplua, PA 


Read 








+ 


12 




(Kansas) . 


Math 


- 


- 


- 




12 


25 


Philadelphia, PA ' 


Read 






+ 


+ 


' 3 






Math 






+ 


+ 


3 


26 


Seattle; 


Read 






+ 




5 






Math 






+ 




5 


27 


Berkley, m 


Math 






+ ' 


- 


5 


28 


Duluth, MN 


Read 








+ 


3 






Math 








+ 


3 


29 


BostOil, MA 


Read 
















Math 






+ 






30 


Quaha, NE 


Read 








+ 


2 




♦ 


riatn 










2 


31 


Omaha, 


Math 






+ , 


+ 


2 


32 


r4enciTdnee , - MI 


■Math 






V 




15 


33 


Grand Rapids, MI 


Reed 










15 






Math 










15 




r 

V 
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CANDIDATE SITES mili INDIVIDUALIZED AND/OR STAIIDARDIZED PROGRAMS (Cont'd) 
- - ' (VERIFIED) 



DOCUMENT 
ID NO. 


SITE 


— » 

ppOGRAJlfS) 


CLASSIFICATION mTKLX CRITERIA 
P/0 ' D/P ALP PACE 


MATRIX 


34' 


Sault Ste Jlarie, 141 


s 

Read 










3i6 ^ 


35 


Inkster, f4I 


Read 


- 


+ 


- 




' 15 


36 


T^lington Co. / VA 


Read 


+ 


+ 


+ 




• 5 


37 


Salt Lake City, UT 


Read 




+ 


4- 


4. 


3 






Math 


r 


+ 




+ 




38 , Waukegan, IL 


vRead 








4. 








Math 


- 


- 




+ 


12 


39 


* 

Indianapolis, IN 


Read 








4. 


12 






Math 


- 


- 




+ 


12 

t 


40 
* • 




Read 


♦ 


- 






16 


41 


Trenton, NJ 


Read 


+ 


+ 


- • 


+ 


9 






Math 


T 


J, 

T 




! 


9 


42 


St. Louis, m 


Read 


- 


+ 


+ 


+ 


3 






Math 




^ T 


1 

T 


! 

T 


3 


43 


Wayne, MI 


Read/Parent 


— 


— 


— 


— 


16 






MatiyParent 










16 


44 


RichrTDnd, VA 


Parent 










15 


45 


Lawrencfeborg, IN 


Parent 


— 


+ 


— 


— 


15 


46 


Yakima, -WA 


Parent 


- 


+ 




- 


15 


47 


District of 


Read 




+ 






15 




, Colurnbia 


Math 




+ 






15 


h 


Texarkana, AR 


Read 




+ 


+ 


+ 


. 1 


1 




Math 


+ 


+ 


+ 


+ 


1 


i 49 

/ 


Mt. Vernon, NY 


Read 










16 


50 


Bristol, VA 


Read 


+ 


+ 


+ 


+ 


1 






Math , 


+ 


+ 


+ 


+ 


1 


51 


Louisville, KY 


Read 


+ 


+ 


+ 




1 






flath 


+ 


+ 




A 


1 
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CANDIDATE SITES mTH INDIVIDUALIZED AID/OR STAT^DARDIZED PROGRAMS 

(VERIFIED) 



(Cont'd) 



DOCUMEOT 
ID NO. 



SITE 



CLASSIFICATIQN MATRIX CRITERIA MATRIX 
PROGRAM (S) P/0 D/P ALP PACE ' BLOCK 



52 


Qnaha, NE 


Read 




+ 


+^ ^ 


+ 


3 








T 


J, 


4- 




1 








+ 


+ 


+ 


+ 


1 




*' irUX XJLcuiCl ^ I'lHi • 


Keau 


1 


1 

T 


1 




r 

b 






j4th 


+ 


+ 


+ 




- 5 


55 


Parsons, KS 


Read 






+ 


+ 


. 3 


DO 


jjuca naven / rv\ 


Read 


1 




•f 




1 






Math 




+ 


+ 




1 


57 


.Oakland, CA ^ 


Read 


+ 




+ 


— 


5 






Math 


+ 




+ 


- 


5 


58 


Los Angeles City, 


Read 


+ 




' + 


+ 


1' 








+ 




+ 




1 






Read 


+ 


k 

+ 


_i 




1 


60^ 


rje\vpojrt hjeacn, ca 


Read 


+ 


+ 




+ 


% 

1 






Math' 


+ 


+ 


+ 




■ 1 


OJL 


"Pa e4- C4- T rw i <?• TT 

ija^u OL,« JLDUIS, ±1j 


Read 


1 








z 






Read/Parent 








» ♦ 


lb 






Matli/Parent 


- 




< 


- 


16 


63 


San Jose, CA 


Math 


- 


+ 




+ 


3 


64 


Arlington, MA 


Read 


+ 


t 

+ 




+ 


9 




Hartford, CT 


Read 


— 




+ ' 


« 


-% 


66 


Wichita, KA 


Read 


+ 






+ 


9 






Math ^ 


+ 






+ 


9 




Jefferson Co., CO 


Read 


+ 








14 


68 


Clarkston, MI 


Read 


+ 






+ 


1 


69 


Dade Co. , FL 


Read 


+ 






+ 


i 


70 


Dade Co., FL 


Read 


+ 


+ 


+ 


+ 






(New Century) 


Math 


+ 


^ + 


+ 




















\ 
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CmDimHE SITES raTIl INDIVIDUALIZED A^D/OR STAIClMyDIZED PROGRAMS (Cont'd) 

(VERIFIED) 



DOCC^IE^]T 
ID NO. 


SITE 


PRXLRAM(S) 


■"■ .'J'' ' — ■ ■■■■■■ 

JlassificatIon mTRIX crlteAia 

P/0 D/P ALP PACE 


MATRIX 
BLOCK 


71 


Dade Co., FL 


Read 


+ 




- 


> 

+ 


9 




(Iloffrran) 














72 


Dougherty Co., 


GA Read 






+ 


+ 


3 


73 


Pender Co. , NC 


Read 


+ 




+ 


- + 


2 


74 


Ft. Ifcrth, TX 


Read 










16 


75 


Flint, MI 


Math 


+ 




+ 


+ 


1 


76 


Davies Co. , KY 


Read/Parent 


+ 


+ 


+ 


+ 


1 






f lath/Parent 


+ 


+ 


+ 


+ 


. ^ 1 






(71 Local Districts) 


(119 Projects) 
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■■ APPENDIX 8 
LIST OF POTENTIAL CANDIDATE SITES 
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ESEA TITLE I SITES 



Title I ESEA, Preschool 
Bessemer City Schools 
Besserner, Alabama 

Baptist Hill Kindergarten 
Butler County Board of Education 
Greenville, Alabama 

Irnprovenent of Basic Reading Skills 
Sylaeauga City Board of Education 
Sylacauga, Alabama 

Flagstaff Renedial Reading 
Flagstaff 'Public Schools 
Flagstaff, Arizona 
» 

Exemplary Project ^ 
Fladng Vfells Scl'pols 
Tucson, Arizona 

Project Catch-Up 

Newport 'Beach Public Schools 

tfeuport Beach, Ccuifomia 

Pupils Mvancing in Learning 
Mams 12~Thorton-Northglenn 
Denver 4 Colorado 

.Intensive Reading Instructional Teams 
Hartford Public 'Schools 
Hartford, Connecticut 

Reading Laboratories 
Dougherty County School System 
Albany, Georgia 

Readying/English Rotation Project 
^icDuff ie County Schools 
Tlxxason, Georgia 

Reading ^Project 
Keaukaha School 
Hilo, Hawaii 

" Project Congupst ^ ^ - - 

East St. Louis Public Schools 
East St. Louis, Illinois 



Corrective Reading Program 
Wichita Public Schools 
Wichita, Kansas 

Project Understand 
Arlington Public Schools 
Arlington, r Massachusetts 

Clarkston Schools ROTedial Reading 
Clarkston Coirmunity Sc}xx)ls 
Clarkston, ?4ichigan , 

High Intensity Tutoring Centers 
Highland Park Public Schools 
Highland Park, Michigan 

Basic Skills in Reading 
!'5anchester Pobiic Schools 
Mancliester, New Hampshire 

Criterion Reading Instructional Project 
Linden Public Schools 
Linden, New Jersey 

Reading ImppDvevent 

Pender County Public Schc^ls 

Burgav;, Nortli Carolina 

Learning is for Life: Yours and Others - 
Rochvjood'^ School District 427 
Multnanah County, Oregon 

Rar^ial Reading Program 
Newport Public Schools 
Nev;port, Rhode Island 

"RIPPS'J 

Port53Toutli Public Schools 
PortSTOutli, Rhode Island 

The First Calculating and Reading Quest 
Oglala Pul^lic Schools 
Oglala,JSouth DaJ-oota 

Reading Laboratory and Resource Room 
Cacjhe County School District 
Itorth l^an, Utah " 
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ESEA TITLE III SITES 



Project AIM (Assessi:ient of Individualized Mathematics) 
Jasper' City Public Schools 
Jasper, Mabama 

A New Adventure in Learning 

W. T. rtoore Elenientary School t 
Tallahassee, Florida 

Individually Prescribed Elonentary Instruction Program 
Lowndes County Public Schools 

Valdosta, Georgia ' ^ 

Individualized Language Arts Diagnosis, Prescription, and Evaluation 
RDOsevelt School 
Vfeehav.icen, New Jersey 

A Systems Approach to Individualized Instrtiction 
Grants Pass Public Schools 
Grants Pass, Oregon 

Project CAT'I - Concepts and Jlaterials 
PortsnTOUth Public Schools 
Portsmouth, Rhode Island 

Project PIACE - Personalized Learning T^tivity Centers for Education 
LyncJiburg Public Schools 
Lynchburg, Virginia 
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DISS£MII>F.TIQr; PAMEL 

Project Pegasus 
Tuscaloosa Public Schools 
Tuscaloosa/ Alabaina . 

Rertvedial Reading 
Flagstaff Public Schools 
Flagstaff, Arizona 

Project Catch-Up 

Ne\vport Beach Public SchDols 

Newport Beach, California. 



Ardover's Individualized Readojig System 
Ardover Public Schools 
Andover, Massachusetts 

High Intensity Tutoring Centers 
Highland Park Public Schools 
Highland Park, Michigan 

Conceptually Oriented Math Program 
Columbia. Public Schools 
Colurnbia, Missouri 



Alfiiaphonics Reading Readiness Training Program 
San Francisco Public Schools 
San Francisco, California 



Project R-3 

San Jose Public Schools 
San Jose; California 

Pupils Advancing in Learning 
Denver Public Schools 
Denver, Coloradp 

Intensive Reading Listructional Teams 
Hartford Public Schools , 
Hartford, Connecticut 

Project Sl\RT 

Daytona Beach Public Schools 
Daytona Beach, Florida 

Child Parent Centers 
Chicago Public Schools 
Chicago, IlLinoiS 

Intensive Reading Inprova-nent Program 
Chicago Public ScHoois 
Chicago, Illinois 

Project Conquest 

East St. Louis Public Schools 

East St. Louis, Illinois 

Systems Directed Reading 
Elkhart Public Schools 
Elkhart, Indiana 

Corrective Reading Program 
Wichita Public Schools 
Wichita, Kansas 



Criteria Reading Instructional Project 
Linden Public Schools 
Linden, New Jersey 

Project STAY (School to Aid Youth) - 
^^5ore Public Schools 
Moore, Oklahosra 

Program for Reading Develonnent 
Portia^ ?\iblic Schools 
Portland, Oregon 

Project Read^ 

Pittsburgh Pciblic Schools 

Pittsburgh, Pennsylvania 

Corrective Reading Program 
Newport Public Schools 
Newport, Rhode Island ^ 

PrograntT^ Tutorial Reading Project 
Faiiiiington Public Schools , 
Farmington, Utah 

Exanplair/ Center for Reading Instruction 
.Salt Lake City Public Schools 
Salt Lake City, Utah 

Project SUCCESS 
Poulsbo Public Schools 
Poulsbo, Washington 
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V 



RIGHT TO^READ 

South Routt SchDol District 
Yainpa, Color^ao , ' 

Wintonbury EleiTientary Sclxx)! 
Bloonfield, Connecticut 

Baltinore City Public Schools 
Baltinore,. Mairylard 

William Ivhiting Schcol 
Hblyoke, Massachusetts 

The Lincoln >3odel Nongraded School 
Staples, Minnesota 

Broadus School District 
Broadus, i*5optana 

Plardin Primary School 
Hardin, Montana 

Myrtle Tate Elen^tary School 
Las Vegas, Nevada , 

Ite^z/ark City Schools 
Newark, New Jersey 

Sinclairville Elementary School 
Sinclairville, New York 

Riverside Park Junior Eiigh School 
Springfield, Venront 

Jefferson Elementary School 
Parker subrg, ' V7e,5t Virginia - 

Jefferson Eler^tary Expansion Site 
la Cro.sse, Wisconsin 
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6 

FOuA^ THROUGH PROGRAM iVPDELS 

* Open. Bdueation Program . ' 

Educational DevelopTient Center 
..Nevvix>n, Massachusetts ^ ^ , ' , ^ 

laurel, Delaware ' ^ ' ^' 

^ . Washington, D\q. . . ' . - . - ^ ' 

Chicago, Illinois ' * , 

^ Roxbury, 'Massachusetts ^ • , , 
' PaterscJn, New Jersey ' / 

Johnston County, Itorth Carolina " . . 
• Phil'adelpiiia, Pennsylvania . ■ ' . - 

^ * Scrahton, Pennsylvania 
RDS€ibud, Texas 
. Burlington, Vermont ^ ^ - ' . . 

Parent -Education rfodel ; * . ' ^ ' 

University o^ Florida ' . . ' , ' ' ' . , 

Jacksonville, " Florida ^ 

Tarrpa,. Florida - • . 

lawrenceburg/ Indiana ^ 

Cliattanooga', Tennessee ^ , - 

'RicliTiond, Virginiai^ 

Yakim> ^VJashington ^ . . ' * 

^ California Process ^-jodel • ' - ' ' • ' ^ 

California Deportrent of Education . ^ . 

Oakland, Califo'pvia- 

Responsive Educational Program . , , . 

Far \^st Laboratory for" Educationai Research, and DevelopTient 
Deleuth, Minnesota ^ ' - ' 
Lebanon, Isfew rjampshire, • 
Salt Lake City, Utali 

Individualized Early Learning I?rograra - ' . ' ' ' 

^Leaming Research and. Develop:Tient Center . 
Tlie University of Pittsburgh 

Montevideo, Minnesota ' - ' 

AJaron, Ohio 

Lock liaven, Pennsylvania • - 

Behavior Analysis Approacli ^ < ^ ' 

University of Kansas ' 
^ Meridian, Illinois 
.VfeuJcegan, Illinois -^'^ 
Indianapoli-s, Xndicina 
Louisville, Kentucky 
_ Kansas City,- Misso^ori 
Trenton, Ue^^ Jersey * 
^ Bronx, New York 
Philadelphia, Pennsylvania 
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TucsDn Early 'Education Model ( 
University of Arizona 

Los Angelas, ' California 
^ Durham, Jforth Carolina 

^7alker County, Georgia 

Vincennes,' Indiana 

Des toines, lava . 

Wichita, Kansas- 

Baltinore, Maryland^ 

Lincoln,. Nebrasjca 

LaXewood, New Jersey . 
t Newark, New Jersey 

Santa Fe, !few Mexico 

Fort \>XDrth, Texas 

Follow Through Models fdr which sponsor naterials'have not yet been received: 

<* 

The Parent Supported Application of the Behavior Oriented Prescriptive 

, Teaching' Approach 
Georgia State University ' ' - 

Engleimnn/Becker ^todel for Direct Instruction 
University of Oregon * - . - . 

Cognitively Oriented Corriculim :!odel " , - ' ' 

High/Scope Educational Research Founaation. 

*. • * ' ^ 
Hanpton Institute rongrcided Model 

Hampton Instj;tute --^ * . * ^ 

Hanpton, Virginia . . - , ^ ^ ^ ^ 

Bank Stxeet College ^ of Education Approach 
. Bank Street College ' ^ • 

N^w York, New York ' * ' 
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• The WiscxDnsin Design for Readirtg Skill Develoarvsnt 

Wisconsin Research, arid Developnent Center • 
The University of Wisconsin 
MadisDn, - .Wisconsin 

" 236 school districts have been identified as potential candidate 
^ites; 50 well-intplor^feed sites will be requested from the dfeveldper 
for determination of "likely" sites. ^ 
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■ CXayMERCIAL PUBLISHERS 



High Intensity Learning Systqjas 
Educational Systems Division 
• Randan House, Inc. 
New York, New York 

Miami, Florida 
Baltimore, Maryland 
... Qraha, Nebraska* , 
Brooklyn, New York 
San Antohio, Texas 

iJdividualized Computational Skills Program 
Houghton Mifflin Company 
Boston, Massachusetts 
Flint/ Michigan 

Dr. Caleb Gattegno 
Educational Solutions, Inc. 
New York, Ne,^ York 

Jacksonville, Florida 
Vfest Palm Beach, Florida 
t Bronx, New York 

New York, New York 
Cleveland, Ohio 
mifbrd, Ohio * 
' • Oberlin', Ohio 
i Rocky River, Ohio 

DISTAR Instructional System 

Science Research Associates 

Chicago, Illinois ' \ 
- • ^ Chicago, Illinois 

tount Vernon, New York 

New York, New York 

Lake Os\-7ego, Oregon' ' ' 

Orange County, South Carolina 

SRA ^lathauatics Learning Systan 

Science Research 'Associates ■ 

Chicago II 1 iro is 

San Jose, California 
Skanea teles. New York * 
Qraha, Nebraska' - 
Sioux Falls, South Dakota 

SRA Reading. Laboratory Series- 
Science Resecirch Associates 
Cnicago,- Illinois - ' 

Phoenix, T^izona 

Gainesville, Georgia . ' 

St. Paul, Minnesota 

New City, New^ Jork 
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New Century Publishing Company 

New York, Nev York 

Conpton, California 
Dade County, Florida 
Pontiac, Michigan 

Project PLAN 

Wfestinghouse Learning Corporation 
New York, New York 

Phoenix, Arizona 
Fort Morgan, Colorado 
Longmont, Colorado 
Brunswick, Georgia 
Aurora, Illinois 
Naperville, Illinois 
\^eabDn; Illinois ^ 
Cedar Rapids^HEowa ' 
Pleascint Valley, Iowa 
Portland, Maine 
Grand Rapids, Michigan' 
Wyoming, Michigan 
Winona, Minnesota 
St. Louis, Missouri < 
Ridge'/^ood, Ne^v Jersey 



Education TUI^^l^ Files' Cocur.-entation 

lt)tal Learning Center . 

District of Colunibia Public. Schools 

\^shington, ,DX. * " 

Dade' County Reading Syston , 
Dade County Pablic Schools' 
D^de County, FXofrida 

Project.'ElUS 

B^kley Coonunity Schools 
Berkley, Michigan ^ 

pierce School Project 
Detroit "Public Schools 
Detroit, Michigan 

Project -TARGET 

Grand. Rapids Public Schools 

Grand Rapids, Michigan 

Pjcpject READ , * 

Inkster Public Schools . 
TnVqter, Michigan 



Lansing Middle Cities Project^ 
Lansing School District 
Lansing, Michigan 

Project MATH 

Menoninee Public Schools 
Menominee, Michigafi 

C-SEP Program - ' 
\^yne-VJestlajxf Cannunity Schools 
\^stland, Michigan 

Individualized Reading ^program 
Arlington County Puolic Schools 
Arlington, Virginia* 

^IiK^ividualized Reading Pfogrant 
Brigtol Pablic Schools 
Bristol, Virginia . 

Prescriptive Learning Centers 
Fairfax County Public Schools 
Fairfcix, VirgiMa 
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CHECKLIST FOR IDENTIFYING SITES FOR NIE STUDY 



C, 



A* General 

!• Checklist completed by 

on 

2» Name of district 
Address 
Telephone 
School (s) 



3, 



^ _ 


7 


— ' 






V ?y|T 





DRP Project Report ^ 
Jleport submitted by LEA 



4, 



5. 



n 
[] 
tj 

I] 

Location of Document 

n Turnkey- 

[] Other \ ^ 



Turnkey file 
Other 



Contact Person for Additional Infomation 

Name • 

Phone 



B, Minimum ♦Criteria 



2. 
3. 

5. 



Covers Grades- K-4 
Math or" Reading 
"Compensatory Education 

Program is well-iaplenented 
a. Plan followed 
\>'k Evaluation Report . 
c, Monitor/Observation 

Achievement gains 
e. Others ' . 



Program Characteristic^ 

1. Organization • 

a. Center/Pull out 

Mains treara/Se If -con^trolled 

c. Combination 

d. ' Other 



YES 


MAYBE 


NO 


U 


[] 


[.] 


[] 


[] 


[] 


[] 




[] 


r 1 
I J 


r 1 

I J 


U 


[] 


[] 


[] 


[] 


[] • 


■[] 


[] 


[] 


[] 


[3 


- []■ 


[]' 


[] 


[] 


[] 


[]• 


[] 


[] 


T] 


{] 


[] 


[] 


[] 


[] 


[]. 


[]- 


[] 




READING 



DON'T 
KNOW 



MATH 
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Education TUBf^KEY Systerns, Inc, 



Perforaance Objectives Exist » [] YES [] NO 

If yes, are they 



Written 

Have proficiency mastery levels 
Assigned on diagnostic test 
Assigned on teacher judgment ' ' 
Differ from student to student 
Specified in vritten plan 
Other 



Diagnosis 



c. 



d. 



Initial Placement 
CRT 

Standardised test 
'.Teacher judgement 
Age of student 
Other 




Continuous 

CRT teacher-mad£ 

CRT in pre 

Teacher ju'dg^J 
Studen't judged 
Dor\* t* know , 
Feedback * 
To Teacher 

1-5 days 

more than 
To Student 

1-5 days 

more than 
Don.*t know 
Taxonomy Exists 

Ves 
' ^ No 

Don't Know 
If yes, , - • 

Teacher developed 
Publ-isher's manual 
O^het. ^ • 



5 days 



5 days 



READING 
[] ■ 

L] 

[] • 

[] 

[] 

[] ' 
[] 
[] 
■ [] 

4 

READING 

• [}- ^ 
[] 
[■] 

[] . 

[] 
[] 

[] 
[] 
[] 

[] ' 
[] 



.[] 
[] 

[] 
[] 

I] . 

[] 
[] 
[•] 

[] - 
[] 

[].- . 

[] 

f] 
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Education TURNKEY Systems. Inc. 



' ADDENDITM ' 
to . 

POTENTIAL €ANDIt)ATE SITE SHEET 



A. Program Characteristics 

1. Name of Instructional Materials 
a. Basal 



b. Supplemental 



2. Implementation Plan is Described ' 

[] Adequately' 
^ [] Inadequately 

[] Not at^all ^ 

Parents are involved irj ^ » 

[} Establishing Program Goals/Objectives 

[] Establishing Student (Child) Objectives 

[] In-class instruction 

[) At-home instruction 

[) Prescribed/structured by teacher 
[] Unstructured, with parental discretion « 
[] Evaluation of .student *s (childs's) progress 
[]' Prescribed/periodic 
[) Flexible/meetings with teachers 
'(] Training provided by 

I) Teacher/building sL'aff 
[ ]-wJ:l^terials .(progran^jncd)^ 
' ly Other * . ' ' 



C. Documentation af Project is 
[ ) Very 'good , 



n 


Avera&e * 




f.t. . ._ . 






# 




[] 


Poor 










1 ' 1 J 
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SITE IDENTIFICATION -CHECKLIST 
NON ^STRICT SURVEY I SITES 



ERIC 



DOCUMENTATION SUMMARY SHEET FOR S.ITE IDENTIFICATION! 









District 


Total Enrollment 




Contact Person 


Telephone 






— ^ — 1 



Name of Program 



Number of Elementary Buildings Using Program > ;_ 

Number of Second and Third' Grade Room's Using Program 



Comments 



Keysort Codg* Format 

Code Field 

General . , : . 

A. Type* of Program • . , 

1. Mainstream (self-contained) 

2. PU'Vlout * - Type I (entire group) 

/• 3/ Pullout- - Type II (selected students) - 1-2-3-4 ♦ 

. .4., Combination 

5.' Other . ' » 

B\ .^Subject Matter Emphasis . ^ - ^ 

^1, Treading 

' > 2. Mathematics \ ^ ^ . 

* *3. Reading and Pai^ent* Involvement .5-6-7-8 

4'. Mathematics andTarent Involvement 
5. Other ' ' ' ' 

€. Years. Program Has Been/Will Be Opera^tional 

1 • One , • * .5._ Five or Mere • 

• 2. Tra 6. Operational in 76-77 

3. ' Three - , 7. Not joperational in 9-10-11-12- 

4. Four • 76-77 

D., Projected Program Stability Within District for 76-77 •• 



1 . Same Program 

. - 2. Same Prihcipals 

3. Same Teachers ■ 

4. Same Students 

5. Combinations of Above 



13-14-15-1 6- 



E. Number of_ ^atentiaJ- Study ^ciiQDls_ iji„DisJ;ni-X.t_ 

1.1-2 .5. 16-20 

2. 3-5 . 6. 21-^30 

3. 6-10 7. More than 30 17-18-19-20- 

4. 11-15 

F, Number of Potential Study Rooms- in District 
•1. 10 Only 4. 21-25 

2. 11-15 '5. 26-30 2^22-23-24 

' 3. .16-20 ■ 6. More than 30 



15,2 



G. District Willing to Participate in NIE Study 


Code Field 
• 


1. Yes 

2. No' • • ' 

3. P>eserved Judgement (Maybe) 


. •25-26-27-28 . , 


H. Documentation Ava-ilable on Quality of Program 

Implementation 


* 


1-. DRP Document 

2. Outside Validation^ Report 

3. Evaluation Repoj^t * , ' 

4. Publisher Recommendation 

5. Other 


29-30-31-32 


II. Degree of Individualization 


* 


Av Written Performance Objectives 




*K For Each Individual Student 
2. For Classroom/Center 
3» . For Small Groups ' 
4. For Program . . - ' 
. ,5. Other , . , 


B1-B2-B3-B4 


*B. -Diagnos'is/Prescription 




Continuous on Individual Student Basis 

2. Initial Place.^ent Only ' 

3. Periodic (e.g., mid-semesteri 

' . 4* Other . * 


. B5-B6-B7-B8 - . ' 


" Learnfng Paths •; . . 


- - / — ~ 


Prescribed/Followed on individual Student 
'2. Student Selects from Alternatjves . 
3- Small 'Groups Have -Separate Paths 
4. Other , 


Basis' 

B9-B10-B11-B12 ■ 


• ' D. "Placing . ... 




*K Determined For/Bv Individual <;fnHpnt - 
?r Determined by Teacher Judgement 
"3. .Small Groups Set Own Pace 


' B13-B14-B15-B15'- \,^.^ 


E. 'Major Instrument Used In Diagnosis 




: , ]. CRT/ORT ^ - ' 

.2. Standardized " - - ' 
3* Other . • - - 


B17-B18-B19-B20 


: * Required to meet modeT criteria for maximum individualization 


erIc . i-'^'V , 









, Code Field 

Parent Involvement ^ • : 

A* General PAC Type Involvement ^ - . . 

B. Parents Assist -in Classroom Instruction 

C. Parents Assist in Home Instruction' ^ L1-L2-L3-L4 
^ Parents Establish IndividuaT Student Objectives 

£• Other 



154 



r 




i 

. APPENDIX. 11- 
RROGRAM IMPLEMENTATION INSTRU^fENT DESIGN 



t 




PROGR^M IMPLEMENTATION INSTRHENT DESIGN 

A. Purpose . " , • 
The enclosed instrument is designed to: 

t Specify general categories of activities ^vhich are common to most. ' 
m ath and reading pro grams; . ^ ^ ^ / 

• Identify the specific subactwities and their relative importance 
(i.e., scale 1-4) to successful implementation; 

# Identify the't>pe(s3 of data collection instruments (e.g., structured 
interview, checklist, and indepth probe inten^iew) but suited to 
collect valid and reliable infonnation on the degree to \\hich the 

/program is being implemented as intended. 

B. « Program '! nformat ion • ' . ^ ^. • 



FRir 



1. Name of Program ' Alpha Learning II Reading Program 

2: LEA Locati6n ^ Grand Rapids (Michigan) Public Schools 

3. Schools Using Program Fountain, Mulick Park 



4. liiA Contact Person Kallacc Xori^rove, Director, Program Dov^elopmerit 

• Telephone: ^ \ ^ 



5. Individuals Responsible for Completion C. Blaschke,' TUR\KB' 

6. ^ LEA/Other Officials Participating- R, Swart, teacher- trainer , 

R. Bogo^, Vice-President Alpha II ^ ' ^ 

Procedure Used ^ - ' . 

The procedure used to complete this instrument was (please describe) 

Blasch'ke reviewed .documentation of ALPHA program in Grand 
Rapids' Public Schools (TUllXKEY files) and identified preliminary 
categories of activities (9/18/75). Met with Bogo (9/23, 24/75) to 
refine subactivities. Bogo met with Swart (9/25/75) to confirm sub- 
activities and assign weights. * • - ' 



i5r 



- - 


I 


0 


p 


RATING 


student Prescrirition 'Records (Readina) 








:3' 


. ' completed correctly 










Student Prescription for (Math) 










completed correctly ' * 










. • ■ ■ \ 

C* Instructional Planning 








• 


!• Role of individual or Group Instruction 
'Within the System^ 










Students are grouped for. introductory 




« 




• 3 


presentations (Math) !-:> 










Students are grouped for introductory 








/ 


presentations (Math) 3-6 










Students are grouped for skill pre- 






^ 


3 


sentations (Reading) Grades 1-2 










Students are grouped for skill pre- 










sentations (Reading) Grades 3-6 


• 








Teacher follows a weekly plan for 










individual-small group instruction 








' ' Teacher has scheduled systematic per- 




/ 




H 


. formance review sessions with student 










2. Nature of Media-Teacher, Tape, etc* 






t 




Students. use HELP CARDS correotly 




rt 
/ 




J 


Teacher uses HELP BOX to plan 


'A 


<< — ■ 




2. 


individual and group presentations 










Instrjactional Management ' • . 






* 




1* Student Records/Information Retrieval 










Class 'Summary Chart completed: 








■ 


for Reaaing - Chart 1 (Sul) 








3 


for Reading - Chart' 2 ^ 










• ' for. Math ^ ' ^ 


• 




■2. 


^ Student Cards^ updated (Readina) 


• 








Student Cards updated (Math.)* 








5- 


S^tudent Cards^ Posted -(Math) 


c 
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• 



Daily Task Log Maintained 

For Evaluatui^i^ Testing Only: 

^ Objective Attainment Recor^ds coijipleted 

for target students 

/ " . ■ 

2. All Infornvation Sources Necessary to Make 

Instructional .Decisions - s ^ 

Student Prescription Record maintained 

correctly 

Student progress by frame with excep- 

tion ^of Sullivan . . 



.All scores recorded 
All re-do's recorded 

Daily, Task Log shows an average of 1-3 
tasks per day. 

Criterion Mastery Test record main- 
tained 

Task Log checked daily by teacher 



3* Nature of Decisions and Frequency of 
Decisions 

I Is branching evidenced on Prescription 

Sheets (Reading or Math) 

— Do sheets indicate more than ^:wo 100% . 

in succession ^ for same objective with- 
out branching 

Do sheets indicate a succession of 

poor SQores without branching' 

^ Do sheets indicate proper ^use of CMT^s 

^ What optional prescriptions are avail- 

" ' able in Math "(check Student Card) 



• Classroom ^lanagement 

1 . Use of Resources 

Teacher plans * for/with the parapro- 

fessional and other adults' in the 
room on''"a^cheduTed-weeK BasisT'^ 

Student checkers are being used 
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student tutors are being used* 

Later el students are assig;ied to 
hel'p^ early el students when needed 

Paraprof essionals know their respon- 
sibilities , " * • ^ 

Paraprof essionals know how to find^ 
and use all materials (P.C.'s, tests, 
'answer keys, etc.) 



Org an £ z at ion of Le ar n ing- E nv ir onmen t 
1. student -Movement 



The physical arrangement of the class- 
.rqom accomodates traffic flow arid in- 
structioji • ^ 



RATING. 



The necessary materials are readily ac- 
cessible to students (centrally placed) 



T>iere- is a '*test table" or'"CMT Table" 
where students take major tests 

.The teacher and aide are on opposite 
^ides 'Of the room 

There are systematic classroom proce- 
dures for gettii^g, using, and returning 
materi^als^ 

Students "have folders for reading and 
ma th^ 'prescriptions 



The students* have been trained to follow 
systematic checking procedures 



ThB students know what to do next when 
a task is completed 



The student returns tpwork after handing 
ix). a check test 

The student signs* up for teacher help when 
desired • * . ' 



The studeot signs up for spelling^ tests 
or vocabulary tests when' needed 



ERLC 



The -student can' verbalize his workflow 

folder — ^materials — T^^take P*C. 
give to student checker 
return to seat and complete next task 

. .159 



3 



3_ 



3 



-2^ 



student Motivation 



The teacher knows the building incentive! 
budget . 



_ Teacher's reward system adheres to 
building guidelines . , . 

The teacher contracts with' studi^nts 

The student can verbaliz^e 'the contract 

^ There is a reward menu appropriate to 
.all students (e.g. a store stocked with 

- 4:h-iiig-s— ^tiat-are- r-^-i-nrforGin-g^ -to—s-tudeatS' 

^ The teacher has and follows a reward 
schedule for achievement 

^ The students can verbalize the reward 
schedule for .achievement ^ 

There is a Free Room or- there is an RE 
Area in' the classroom where there are 
, activities for immediate reinforcement 

^ The use of the Free Room or RE Area 
is c ontingent on completion of a con- 
tract or task or ^specified behavior. 



The adults, in the room consistently 
reward appropriate behavior 

Adult verbal beiiavior is positive 

~M lrke-^thB"^way-th±S" group rs" working) 

Staff continually finds new ways to 
motivate students 



PROJECT EVALUATION 

Involvement of Students/Staff /Parents 

Wgre parent questionaires used prerpost 



Were staff questiortaire's used pre-post 
for inform'ation and attitudes regarding 
program ^ ^ • 



^ Were, student preferences and interests 
evaluated . " - 



. IGO 
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B. Types of ^TEvaluation Recommended 



Use objective -i^^ferenced testing 
system which rela^es^ to program 
recommended 



Use of standardized tests recommended 
MAT, WRAT, SDT - 

Use of self-concept inventory for 
students recommended . 



CS Data collection 



On-going evaluation of objectives rec- 
pmmended. Pre and post-test as instruc- 
tional sequence requires 



Analysis ' 
*E Reporting ^ 



Note: 



Most school systems use theif own evaluation system. We 
recommend tjie objective referenced testing -system with 
continual. pre- post testing of objectives! We also recom- 
mended pre'-post inventories oh tc^acher attitudes and teacher 
acceptance of individualized instruction. 



RATINiS 
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CATEGORIES OF VARIABLES 



PROJECT PREi^ARATION 

,. Project P lanning 


1. Parent- Involveijienf 




RATING 



Observation 
Checklist 



Presentation made to PTA 

Approval 'by parent advisory council if 
Comp. Ed.' funds ate used 



2. Program Goals 



Can Administrators identify program * 

goals? - ' 

Teacher training for managing an in- 
dividualized classroom in reading^ or 
mrsthematics. ' ^ . ' 

Increase student achievement. 

Increase positive self--concept of 
student. ' 



3. Program Design 



Determination of prograni use by 
..teachers and ^ides (center vs. self- 
-contained vs. team teaching vs. pull 
. out, etc.) 



Determine evaluation testing system to 
be. used (if relevant) 



Specify number ojE target students for 
special testing ( if ^ relevant) 



4. Establish Responsibility /Authority 



•Designate school administrator as 
facilitator. 



5^. Identify/Select/Procure Resources 

--eL-rStatt-.^- • f"^ 

Reassign or hir^ teachers/aides as re- 
quired by program design 

. ' ' . - ■' ■ 1G2 ■ 

ERJC 



2_ 



2. 



2_ 



b. Facilities 



RATING 



Order building modifications and furni- 
ture, (Special Education population o^$y 



c. Special Equipment-Materials 

« 

Order all commercial materials 

Order all supplies 

B^-St^att -Train-lnq 



!• Development' of Program ^ - 

(training package already developed) 

^. Involvement of Students/Staff/Parents 



Notify all staff working directly with 
center as to time/place/etc. of in- 
service. 



Select 1-2 representatives of parent 
community to attend workshop. 



3. Logistics 

____ Delive'r all- systems materials. 

Inventory all commercial materials ♦ 

Set up center prior to staff training* 

Designate two day training period. 



4%;Nature of Training Sessions 

Training session is mbdeled after format 
of individualized program. 

Diagnostic Test — Prescription—^ /Test 
Discussion .and Activity 



PROJECT OPERATION 

Diagnosis and Testing and K Prescription 
All students pre-tested 



ERIC 



All student' Rx matrix completed 
(Kea.ding only) , 

All student, cards on file (Math) 

Class Summary Chairt completed (Math) 




- 163 



A//f 

, 3 ' 



0. 



3 



1 



. / 



3 



ir/' 



APPENDIX 12 
DRAFT 

IMPLEMENTATION ASSESSMENT INSTRUMENT 



164 



ERIC 











o 






» — 1 






< 












2: 






LU 






2: 


LU 




LU^ 




u. 


—1 


ZD 




Q- 


q: 


a: 


s: 


h- 


Q 




cx> 






2: 




—1 


»— * 










LU 






2: 

LU 






0 





a: 

LU 

o 



o 
or 

Qt. 



0^ . 



a; 



c: 



C 

(1) 



to 
X) 

•OS- 

q; cr T- 
O ♦ 2 

Q. q; ^ 

£ > u 

r- Q; r— ^ 
O- N 5 
E -r- C 

•r- ^- O, 

'C 15 -»-> O 

a; "O T- 

O) .r- +-> +-> 

> C tT3 

to E c: 

c: d) QJ 

E C Er-^ 

S- E • 

00- 

y E ^ 

Q- to Q (D 
US- "O 
S- T- QJ •r- 
I3 +-> O QJ to 
O to s- g 
>>Ti D_ cn o 

r— 4-> 13 » O) 

O S- 



<1> u 
O SI 

sz u 



•r- c: 

to T- 

to c: 

q; -r- 
•r- to E 

E a> to s- 

a; 



to 
s- 

13 

to ' 
f3 



+-> = 

a; 



s- o o 

_ O -r- 

■O 14- +J 

O ^- f3 

O QJ O 13 

+J +-> r— • r— 

to JD to r3 

to 'r- C > 

•r- r- O fO QJ 

•r- q; 

to fO'i — E C 

c Q. q; 

O to Q. d) ^ 

•r- fO fO +-> 2 

to -O (D S- 

d) 13 

13 +-> O +-> 

O" O) '+-> O -C 

S- O IT3 

•q; C T- 

10 ' CO) 

O) <D r— fO 2 

-C +-> I— 

+-> C T- <D -O 

•r- 2 > C 

4- fO 

cj c: 



to +-> 
o o 
D. c: 



hr to 



4-> 

^ to fO S- 
13 -O E -C 

Q.I— <D +-> TD 

13 4J T- 

r- +-> to 

C C 

>^ O 

C +-> (J, 

e O O 

► Q. +-> 

<U E C 

'r- 'r- 



E 
a; 




c 
o 



4- 
O 

1 

-c c: 

U O 4-> 

q; >> o 

4- 0 -r- 



O I 



q; to 

= s- 
to o =J q; t. 

S- <U -f- •'^ 
13 q; U 3* ^ 

•o +-) o cr J5 

^ ^ m 

^ .^^ a; 

^ ^ "fS 
o q; "O 

flj 

c "O to ^ 

0 q; =3 ^, 
-I— to cn o 2f 
+j =3 cn 

O <D to 00 

T- -O -O 3 
S- r— <T3 "O 

q; 13 q; 
> o o 

U (TJ o 

^ 5- _ 

> =3 ^ 

1 -r- >- x: ^ 
c: -M 2 
o q; ii 

<D c: « 

.— 13 O ^ 

X) O 'r-, 

•r- >^ +-> • +-> 

to to "o c: 

to to <U QJ <D 
O <U 13 -O E 
Q- Cr-r- 13 



o 
o 



a; 
+-> 



- 13 



q; 
a; 



q; 

0 to 



to 



q; >, 



-o +-> o +-> 

cn (U f;j <o 
c o -c Q_ c: 

o -J-> 

„ 

Q. 

o . 

<u > _ 

+-> S- 'r- -C 4- ' 

13 CO +J .r- 
-C -o +-> 
+-> QJ +-> C C 
•r- O -C 'r- 0) 

2 o cn -o 
•O Q. E O 

Q. <U -p +J to 

Q- -C c: to fo 

O +-> <D CJ 0^ 
+-> "O 13 I— 

--^ ji^r c tr Ol 

o o 

c: QJ Q. >> *^ 

o -c to c: +-> 

•r- o <D ro c: 

+-> ^ q; 

- E 

O to r— O 13 
Q. +-> (C 4- S- t 

•o'^q; o c 10 
c: ^ I— o c: 

fO, to *r~ T- 

cn ro o 
+-> c: <D o ' 

-C 'r- to T- 4- 

2 c: 4- 'r- 
Q- o; 

— to <U Q- 

O QJ > to 
4- 

QJ 

QJ <U +-> 

c:,j= J= T- 4- 

H-i -H I/) O 



•r- O 

QJ O 
-C 4- 



ERLC 



to 

cr> o c 

=5- O 

to 

<U rtJ U 

<Xi 4-> 1^ 
Q) I— 

CO O 
Q- <U U 

S- 

3 rtJ 
C "O -♦-> • 
O <U rtJ 
•I- (J 
-M O 
1/5 S- S 
<U Q- O 
3 I— 
O* I— 

O 

Q_ <u 

3 O 
O 4-> 



o 
^- 

-o 

(U 
to 



I— C -r- 

•I- rtj 

<U -P 
S- c <u 
ftJ O 

to +-> <U 
<U to 4-> 

s- a; 5 

(U (U 
(J +-> "O 
O ftJ ftJ 

O O 2 

•r- ^- 

-P 4-> 

(J C 

•r- ftj 

I*- > -o 

-r- <U <U 

S- r- 4-> 

<U <U- ftj 

> S- 4:^ 

to 

(U (U 

I/) -O ^- 
I I— Q) 
C 3 »r- 
O O S- 

ftJ I— (U 
•r- (U XJ 

C -o 

<U I— 
-P 3 13 
O O O 

• to 

O 4-> 

^ in 

s- cn 
.<u- cn 

-n c 3 
.3: w 









Q) 






"O 












> o 


in 




Q 










































-Q C 


-P 






in 




in E 














Of* 










Q> E 






O 'r- 












O , Q) 






in > 












i/j 


rP 










^ rt I 
vi/ 


r- 
















O 1 








l^ 
















/rt 








pi 

to 




ftj (J 












to 4-> 






• C T- 


(U 




O 


-o 




•1— U 


♦i— 






> 




in <u 


p 




<D 








c. 




CT 






(U 






o > 


CO 




c <u 








(U 


(D 


to r— 




S- 


C <U 


Q. 


Z3 


•f- JD 
















u 


c o 




o 


o >, 




u 




Q. 


CO 






to E 


o 


c 


4-> (U 


o 


(U 4-> 








E 


-p 




<v 




to r~ 


■p 


u 






•r- 


-o C 




^- 


(U o 




•1— 




u 










p -r- 


<u 


> 
















o 


-p. 






•nr 


<U 4-> 




to 


JC tn 




» 


4_> 




C 




► s 


o 


^- 






o o 










o 




in 3 






vftj o 


Q- 








0) 












ftJ 




o 


U 







IGG 





_7 




















•r- 








> 








4— 














cn 










c 


a; 






s: 


4-' 












O 


O 


O 


O 







Q. 
E 

(O 
X 
(U 

o 

4- . 

^ CD 
03 

4- 

(D CO 

C T- 

O 

r-~- 

03 U 



0) 

CD x: , 
o o 

E CL 



*0 



o 

4- 









03 




E 


> 




03 


03 












</) 




o 


-M 






V) 






(U 






+-> 




q; 




2: 




a 




+-> 








^- 




4- 






O 








<y 




+-> 








V) 




03 






Q. 


0) CO 








o 


+-> 


<D c/> 




03 


JC O 






4^ C 






a> 






CD 










o 


< -o 




4- 








r— - 




o 






CO 


Ol. 


CO 




\ 


q; 




o 


>- 





1 



-a 

Qj a; 

c o 
a. 

c 

CD </i 
"D I — ' 

3 rO O-. 
4->-r- V) 

(/) S- '4-> 
<U C 

O 

5 ra -D 

>- a> V) 

o sz . 

CD r— 

o o j:: 

u ^ 4-) 

c cu o 
03 cr 

CO 03 

^-C cu (/) 
03 CU 
cu cu 4J 

> H 
•f- cu 

CD <0 Jli 




oo 
CU 









t 




























c 












u 










CO 








CO 


cu 












cu 






c 


CL E 






cu 




03 






"O 




oo 








c 










cu 


cu 






CO 




sz 




O 




o 








o 


4- 










4- 












o 






















QJ 




o 


>> CU 


E 


OJ 




c 


V) 






03 




+J 




00 


E 








: cu 






CU 








03 






o 


O 




4^ 


O — 






CU 






oo 




c 










cu 


b 




' 9^ 


cu 








E 










; 03 


c 








T CO 


03 




cu 


If) 






>> 


u 




* CU 




cu u 






JZ 


cu 








4J 


cn 


03 <U 


Q- 






03- 








c 




V) (-) 




o 


cu 




C T- 


03 




J, > 




O 4- 


sz 




L-r- 




•r- <U 






O 


OO 




«\ 

o 




1 C\J 






oo 














^^- 






4- 














< 







cu 

03 
S- 

u 

cu , 
a.' 

CO 



cu 
x: 

O 



I 



c 
o 



I 

C 03 
03 -f- 
4-> "D 

O C CU 

E CU 
•r- C/> -C 

<u o . 
-c: cu 

03 < 

cu 

s- cu 

•r- CO 
4-> 00 'r- 
03 C CO 
^ O O 

3: a c 



I 

o 

Q- O C 

^ 03 

"D 

C CU CO 

03 r— -r- 

^ JIS CO 

03 g 

03 rO 
> -1- 
03 "O 



to 



CO 
4-> 
CO 
CD 
4-> 



00 r- 
03 CU 03 

03. "D T- 
4-> CU C 



CO 



cu 

JZ I JZ 
4-> C CJ 
O 03 
to CL cu 
•r- CO 4-J 

<u 

cu 

O JC 

<U 
c ^ 

O 4-> ^ 
•r- O 

CLr- 
•r- +J 

CJ ro 1— 
to T- 
CU -r- JO 



to 

CU — 
C OJ 
O -r- 
r— CL 
r— CU \ 

/tJ *o O 

<U 3 
C Or— 

0) 

03 ^ 
>> CJ o 
r— T- — 

O CU 

^ o cu 

4-> cu > 

•f- -f- 

2 4-) cn 



c 

03 
4-> 

o 

CL 



cu 
< 

o 

03 

03 CU 
Q- E 



:5 
o 



03 

c 

<u _ 

+J X> 4-> 



I 

CU 

CU 

CU j:: 
> +j 

4-> 

O 

C ^ 

CU {A 
4-> C 
f— O 

cu a. 
cu 

x: a 

00 



>>r— O 00 

C-> rtJ C cu 
C CU 4-> > 
CU 4-> JC 

o 



cu 

•o o 

4- 



c 
o 

I — ..f- 

I — cu 4-> 

•I- f- ^ 

^ XT T- 

co oi 

CU oo 

G 03 cu 03 

> S- 4-> . 

CO 03 Q- CO U " 



C 4-> 
3 U 
0) 

cu -Q OJ 

c o 

03 ^ _J 

o < 

cn 

'f- cu f— 



CO 
3 



167 





>> 




H— 


c 




O 


CO 




Q) 


c 






♦r- 




C 














> 






CO 








to 






0^ 






T3 


O 






>^ 












to 


0) 




to. 


x: 


CD 


to 


4-) 


> 


fO 






r-~ 


to 




CJ 


•r~ 










c 


4-> 






as 




> 


SI 






3: 


to 


CD 



c 

a; 

to 



a; 

B ' 

as 

to 

as 

CJ 

a; ^ 
"oj 

CO 





t 






Q. 




Q. 


•r— 






s. 




(>0 


CJ 




4-> 






C 


CJ 




q; 








Q. 










4-> 


Q> 




</) 


C 






•r- 




^- 


> 




o 


•r— 






CD 






CJ 




0) 


a 




-O 






E 






- 3 


•o 






10 










sz 


CD 




4-> 


CL 


* 


4-> 


{/) 


tor 


C 


{/) 


C 


Z3 


as 


o 


o 




r— 


<^ 


CJ 


-P 



Q 



0^ 
































o 




O 




c 




c 








-X 


• 








to 


to 




to 




4-) 


* 


S- 




c 




CD 


CD 


a; 


• 


sz 


E 


•D 


to 


<J 




Z3 




03 


4-) 


4-> 




CD 




to 


CD, 


4-> 






E 




CD 


^- 


•f— 


^- 






4-> 


- •r— 


> 








CD 


Q) 




CD 




CD 


CD 


CD 




to 




{/) 






> 




•r— 


O 


CD 


O 


■CD 


4-> 


S- 










•fJ 






-12 




CJ 


•r- 


U 


C 


CD 


CD 


CD 


CD 


x: 


x: 


-C 






4-> 


C^ 

























>> 












o 




to 


vel 












CD 

^ U 
CD C 






•r- 












1— CD 






4-> 


















CJ 














"O CT 




o 


CD 














O CD 




CL 


^- 














1 E CO 






^- 
















CD 


CD 






















CD 










4-> x: 






"O 


4-> 












k 'r- 4-> 




o 


CD 


to 












C 




CJ 


at 


00 












1 ^ 3: 
5 ^ O 






















CJ 


o 


c 










1 ^ r— 








O 










P CJ o 




















1 o u- 






CO 


pt 












1 -Q to 


d? 




u 
















c 


o 


«3 


S- 












1 fO c 


4-> 






o 










R CD 


c 


CD 


(/> 


CO 












CD 


_Q 




CD 


>> 




i 




8 O 3 


00 




C 




1 — 








4-> 


CD 


CD 


a 


Q- 


C 










i C CO 




CO 


-a 




o 










o 


D- 


c 


zs 


00 




CO 


CO 










O 




•r- , 


1 — 










00 


f Cl 




00 


QJ 




CD 






as 


to 




O 


> 




> 


! 






<D 




c 


CD 




CD 






00 




o 










ec 


1 G CO 

\ ^ 


r— 

n3 


<D 


CD 


•r- 


<D 


CD 


O 


Cl • 


-^^^ 












CO I 






4~> 


C 




n3 


ro 


03 






CD, 




«3 


CD 


S- 




S- 


r i 




4-> 


^ 














1 s-t 


as 


CJ 




4-> 










CD CD 


E 


CD 


CD 




CD COI 






. 4-> 4-> 




-C 






c 


1 * 








CJ 


4^ 


_Q 


O CVJ < O t 


< e 


O 



CD 

c 

x: 
CJ <' 



CO 

o 



to 

CD 
>- 



CD 

x: 

4-> 

4- 

O 

4-> 

. c 

CD* 
<J 
S- 
CD 
Q. 

4-> 

as 



O 



O . 



ID 



o 



ID 



o 



as 


2: 




f 












E > 


c^» 






X3 




N <^ 


O 




n ' ^ 


•r— 




B (D 




o 


g ^ 


<D 






Q. 




1 00 








CO 






CO 




9 1 


OS 










i 5 


CJ 


Ovl 








J CO 


ai 




S CD 


cr> 




3 x: 


c 




A 4-> 


•r— 








LO 



o -o 



4-> C 
C O 

CJ 

Q. 
CD -t- 
. Q. U 

CJ 

4-> CO 

as CD 
x: 

3: CL 



o 



4-) 



CD 

x: 

4-> 

CD at 
> c 

•r- 'p- 

CD 
CJ 

CD 3 
CJ 
CD 

>^ ^ 



as X3 

CJ CD 

'r- C 
4-) 

(;3 <D 

E +-> 

CD 4-> 

4-* rz 

CO Q. 







CO 


as 




c 


CD 


o 


x: 




u 


4-> 


rs 


c 


O) 


CD 


4-) 








CD 


4-) 


x: 


CO 


.4-> 






^- 


"O 


o c^- 




CO 






O 


CO 


x: 


O <T3 










1— 





















< 
2: 



c^« 



CO 

(D 
>- 



c 

CD 

CT 
CD 

^- 

O 
x: 



o 
to 



CJ 

>^ CD CD 
as Q) CL 
"O 2 CO 

CD CD CD 
CJ CJ 
C C 4-> 

o o o 
t 













• CD 












c 






1 CD 






as CD 


c 




O C 






> 


•r— 


1 

CD 


O 






CD cr> 00 


C 




c 








o 


CL 


CD T- 


CO 




4-> >^ 


•r— 




x: x: 






•r- O '^'f-> 


4-> 




4-> 4-> 


Cl 






as 


c 


•r— 








•r— 




c 5 


O 




to O T- 






'CO 






>> C ^ 






CJ CD 






r— O 


> 


(D 








-r- X 




> 


c: ^ 






♦r- 4-> O (D 


x: 


CD 


o c 


O 




X D, f— 


u 




•p- as 


O 




CD T- ^ ^- 


3 




4-) x: 


S- 




r— CJ -CO 


E 


r— 


Q. 


to 




- M- CJ O (D 




r— 


•r- E 


CO 








•r- 


CO 




(D _Q (D —J 






CJ s- 






OS- x: < 


3= 


CO 


00 or> 


CJ 




□C D- C3 4-> ^ 



1G8 



iu ? 
I 

O 

LU 
—I 

CO 

O 



Q 

O 
O 

(X 



LJ 
ZD 

cr 

u. 

o 

LU 

to 

O 

a. 



ERIC 





LU 










OO 












+-> 


1 




co 


LU 


on 


C 




o 




•0 


to H 




LU 


i-i ^ ^ 






1— 


OO O 


+-> 


to -r- 




o 


1 »— 1 txJ 


to 






LU 










—I 


occ z: 


a; 


<U C 




LU 


h- < 


j:: 


£ a 




OO 


o 2: o • 

LU LU i-H 


+-> 


C2 > 
to -r- 




U- 


ZD 


^- 






1— 1 


U- LU 0 


0 


a; 






—I 












c 








UJ 2: UJ 


0 






o 




•r- 


C 








+-> 


0 '-M 






ZD 


s- 








0 


0^ 


Cn 




< cs: u- 


0. 


c S 


00- 


oo 


' 0 








UJ 


-J 0 q: 


4-> 


^ c 




oo 


txj cs^ 0 


to 






2: 


2: O- U- 


a 


0 (/> 




o 






0 


Q- 


00 


s- 






OO 


CO 0 00 








LU 


0 :2 








cs: 


txJ C3 0 










a. ^ 


a; -a 0 




3: 


LU h- 








O 


s: 1— 0 


+-> 






—J 


< <C UJ 




0 




LU 


0 Ci- 


to 


u c 




CO 


CD *— * 


•r- 








000 




x: 




LU 




4-> 




0 


1— 


CL »— t -J 




•r- C 


0 


cC 


< 


JZ 


-c 0 




o 


-J 0 




2 £ 




1— 1 


< — 1 UJ 










0 








'2: 


0 0 UJ 










-J :3 0 










4-> 
















c 




a; 




0 








•r- 


•r- 






4-> 




c 












•r- 




sz 






c 








0 


c 




> 


•r- 


(P 






■4-> 


(J 






Du 






x: 


•r- 






4-> 




55 






u 






(/> 


to 






♦r- 


<D 










to 


4-> 


4-> 


Du 




to 






O) 


c 


SZ 


C 


x: 




3; 


•r- 


4J 





icn 



uj cr. 
q: 

UJ 



00 

t 



UJ 

c 



CD 
I— I 
00 
00 

o 

Ou 



E ^ 
m I (u 

4-> JQ I/) 
•r- O O 

4-> -O ' 

<D s: 

- U (D r3 
•r- S- c= 

CO to <U 

o 4-> x: 

O 0/1 
• n- +-> »— i 



U E 



> u 

•r- QJ 



00 03 •»-> O. 



E 

4-) S- 
•I- 13 



c 

•r— 

E 
s- 

O C 4-> 
r- CU 

E -o 

t/i *^ 
(O to 



4-) 

to 
O 

<T3 



CU 



4-> 

, to 
cu 
■p 

cu 

x: cu u. 

■P to -r- 

cu +-> 
c x: to 

•r- +-> O 

c 

c cu cr> 

•r- S- <0 
CU Q--0 

X) E 

o cu 
•o u x: 

o o 
2: -p 



CO 

(T3 E cu 

CU to 

4-) -P O 

u x: 

cu -P 

cu o c 
CO — ^ o 



3 
o 



CO 



3 
o 

>> to (O 

<U (0 s~ 
5- 3 cu 
cu C -P 
x: 

SEE 



ID 
Ou 

o 



Ou 



00 



>• 

CO 



UJ 












^— 00 o 






UJ 


UJ 2: 


0 


-J 0 < 


UJ <: 


00 Q 


0 


UJ UJ 




U- >--4 2: 




1— 1 U- UJ 




»— i -J 






a: 


oc UJ 5: 


UJ 


0 > 








rr 0 




3 :^ <: Z3 




U- 


CO 0 




UJ -J 0 


ck 


CO UJ 


0 


^ ^ a, 


U- 



o ^ 
Cu O 
CO 00 
UJ a: 
or UJ 

Ou 

o 2: 

-J *iC 

UJ cx: 
CO cr> 
o 

UJ cxi 

Ou 
O -J 

o o 
2: o 



o 00 



< UJ 

o o 



O UJ 

2: o 



00 
UJ 



Ui 
00 

o 

Ou 

a: 



ERLC 



cu 



cu 
s- 

to 

a 



cu 
+-) 

u 

(J c^. 
<o E 

to'S- 
■P 

to O 

cu u 

■P Q- 
U CU 



to 

o «+- 
c o 

<o to 

•o > 



•r- O 



O 4-> 

x: u 
■p cu 

O -O 

o o 



o. 

o 



>> * 

cu 
+-> 

u 
u 

to • 

— Cn 
cu 

03 



a) 

05 
-P 

c 
cu 
u 
s- 
cu 



CU 

x: o 
■p 

cu 

O to 
■p 3 

>> ^ 

■P 4-> 
U -f- 
CU r— 
U T- 
•r- jQ 

xj 05 



O 
to 



CO 

E 
0) 



S s 

^ O- 



o 

to 
to 

CU to 
>- 



cu 












■p 


CD 










rC 








■p 




r— 








CO 




CU 








cu 






cu 






■p 




CO 


> 






cu 






cu 






x: 




es 








■p 


LO 


■p 






< 


of 
















•r- 








■p 




ost 


00 






cen 


0 

LO 


c 




















cu 








>> 




Q. 




•r- 
•0 


5 


03 




■P 


o'< 

LO 










05 




CU 




3 




x: 




x: 


•t— 


-Q 








■p 




03 










t- 


U 




t- 


0 


Do 


CU 


OA 




0 


0 — * 
































OS 




Ou 






es 






0 






>- 







ho u 



CU 

> 

•r- CO 

■P U 
O CU 

a -p 
to 
jQ 3 
O r- 
U 

03* CU 
3 > 

•o 

r- +J 
> U 
•r- CU 

C -Q 
•r- O 



+-> 

05 

x: 
■p 

■p 
c 

03 
+-> 

O 



• CU to 
x: Ou 
+-> \ 
o 

cu o 

jD -P 

IX> 

to o- 
■p cu \ 
to -P o 

cu 03^ — 

-p 



u 

CL-f- 
E 4-> 



cu c*' 
t- E 

>^'- 

r- to r— Z3 

O -P O 

•t- cr> CU t- 
05 t- t- Ou 

CO T- -r- Z3 ^ 

M-i XJ XJ u o 



170 



c 
m o 



^ O 
^ ^ 

00 O) 
•r- +j x: 
c cj 

o 

x: "O c 

? 3 O) 

+-> x: 

c 

-o c ^; 

4-> CO 
1/1 ! <V 

S- +-> O 

o V) 1 — 

' CD I/) 
+-> 

^ to ro -C 
c^C ^ 



CJ 

^ -»-> 
to O) 

' 

+-> 

CD 4-> 
C -r- 

O CJ 



C ^ 
O CJ 

C 

CD 4-> 

a. c 

I/) QJ 



(D 



-*-> I/) 



■a 

c to 
x: * 

CO -P ^ 
4_> w I— 

c o 

<D (U > 

3 .r- I— 



to 



^(D 
CD>P 

■ c; > x: 



O 

c 

a: 



> 



3 
a. 

o o 

<J E 



O 



O 
< 
CL 
















a; 






s- 


+-> 




a; 


=3 






o 




-»-> ^ 






+-> 




^- 






•r- 






\lf 


\U 




C 


C 










c: 


£ 




5^ 








OJ 




+-> 


+-> 




<U 


O) 




"O 


"O 




S- 


o 




o 


+-> 








•r- 


+-> 


>>■»-> 


c 




C 


13 




13 


o 




O 


o 




u 



o 








C 




rc ^ 




+-> 








■»-> 5 




C 




<u >> 












+-> > 








>> 








£ 




+-> 




U (A 




<D -r- 


• 


r— ^ 




<D +-> 




LO^ 






> 


>> B 




r— OJ 


r— 


E ^ 




O +-> 


OJ 




"O 


c ^ 


rc 




s- 


a: rc 


cn 



CO 

to 



CD 








to 




S- 








> 












c 






£ 




13 


c o 


C 


•r- T— 






to 






g; C- 






+3 






+J 4-> 


S- 




o 


<D C 


^- 


S- 'f 




to E 


<D 




Cn 


CO O 


c 


+-> 




CO 1 




O) tD 




+-> cj- 


<D 


>> 




c 


to 


fO o 


+-> 


S c 


Q. 




<D 




U 




u 





CO 



CD 



CO 



to 

CD 



(A 
•r- 

JC 

+-> . 

•r- 

10 

+-> 
c • 

CD 
"O 
13 



CD 



+-> 
c 

CD 
S- 



O c^' 

c: 
^ o 

O 
to 












1 


to 














c 


to 






C 








S- 


<D 






<T3 




B 






r— 






-P 


c 


lO 


O 


<D 




S- 




10 


•r— 


S- 






<D 


CD CO 




S- 












CD 




O) 


C 


o 




C 








x> 




S- 


O 








c 




Q.-C 


O 


a 


o 2: 


uo 




^- 










>>^ 






o 


"O 




S- 






J— 


to 




CD 


O 






o 




-p 


CD 




c 


CD 




4-) 




c 


S- 


•f— 












O) 


Z2 










+-> to 




•o 


+-> 


<o 






-p 


C 4-> 




3 










c 




«P 


c 


"O 




CL 


> O) 




CO 




•r- 


4-> 






CD "O 


^— 




CD 


> 










O 




•r- 


o 




C 


CD 4-> 




O 


■»-> 


"O 


o 


§ 


•r- 


S- 0^ 





.172 




. a; 






















t; o 


















CL 




+-> 


O 'r- 


< 


•r- 












</> 






r- 






s 












+-> 


a 




c 


c 






^ ' o 




1 §- 










o 




I ^ 






: o 




^- 


u 






r CO OJ 










o 
























SO 


K Cl 


CO 




dJ 


^- 




>- 





° 1 



CO 



4|f 



It 
o 



0? 

X 
(D 

o 

+-> 

> C 
fO o 





CO 








O 




r> 




a; 




r- a; 




















0^ o 












o 


• 


o * 






o 


s- c • 


to 


<D o 






o 


# » 1 ^ 








C 






o 




<1) 


^ Q. • 


x: 


</) X 4-> 


<-> 

















fO Q. 




















^ to 








4^ C 








"O 








<D 




E to. 




















w 




(J 








o' 








^ 10 


41 


dJI r" 






(J 




<D 




Q. 


O <D 


</) 


QJ 




XI C 


i/> 


O 'r- 





Cl 



4 



00 



CD 



O 

O to 
0) r- 



to 
to 
a; 
s- • 

O 

s- 



I 

cr 
o 



o 

3 
S- 

to 
c 



o 
o 
o 

(T5 



c 

0) 
+-> to 
O 

SZ 'r- 
> 

0) 

CO O 

O t/> 
4-> r— C^- 

.>>'f- O 

•fO 0) -»-> 
to 4-> O. 
U*) «T3 T— ^ . 

£ 

O 

0^ O to 
C -f- O 
£- 

4J T- O. 
•r~ O 

t/) Dl O 



o 



o 



0) ^ 

^ to 

3 CNJ 



•p- LO - 

i= a-) 

5" 

0) 

^ o 

o 

sz 

o 



to 



CO 










to 










(T5 




C 










•r— 






O 




C 






^- • 




•r— 

f 






O 














<D 






.-o 




4-> 






s- 




0^ 






o 




"O 






<J 










<D 




S- 






s- 




o 


























r— 




■o 






to 




<y 






s- 




to 




2: 






3 






> 










o 




■o 










s- 






c 




o 






(O 




















0) 




s- 






s- 










<D 


o 


to 




0 


JZ 










4-> 




x: 


(/) 








4-> 






(/) 






c 




> — I 




to 












D. 










3 




CD 






O 






o 


s- 




H- 






o 






to 






to 




<D 






<D 


- s: 


>- 




(T5 


>- 



CD 



E 
s- 

O 
D- 

(D 

sz 
+-> 



to 
s- 

<D 
Cl 

<D 
to 

■o 

to 
3 



■o 

3 



to 
<D 

a 

•r* 

(D 
(/) 

<U 

+-> 

O 

<D. 
S- 
3 
4-> 

c 



JZ 
4-> 

+-> 
O 

■o 
c 









s- 




ca 


> 






>> 




<u 


Q. 


-C 




4-> 


>> 




<D 




» — 1 


+-> 



<T5 
<D O 
•O to 'f- 
C 3 4-> 

r— fO 
•f- "O 

CL 
O 

O) Q. to 
E fO'CZ 
<U O 
D> U O 

C (1) <D 

(T5 x: S- 

S 4-> (T5 



O 
O 



c 



"O 

+-> 
c 

<D ^ 
E 00 
<D 

r— f- 
•r- 21 



O E 

^£ 

O 
c s- 

•r- D- 



174 



UJ (/> 
> UJ 

»— * UJ 

o a. 



CO 

» 

o 




u 

xz 
<J 

•o 

c: 

a» 

Q. 

to 



o 



UJ 

o 
< 

CL. 



UJ «• . 



CO O' • 

I H-I.UJ 

2: H- O 
O < 5 
H- < 
Q 2: Q 
Laj H-t 

2: rD 

UJ o 
-J 
a: ou a: 
UJ s: UJ 
c> »— « ni 

< z:> 
:< q: u- 

o a: 
UJ a: o 

CL. U- 

O Q 
00 O CO 

cx: o 2: 
UJ o o 

CL. I 

UJ H- 
_ H- O 

< < UJ 

to: o a: 

o *— « »— « 

O O Q 

a: 2: 

CL. »— « _J 

, < 

-J Q a: 

< -J UJ 

o 2? 2: 

O. O UJ 

i-j :s o 



4-> 



O 

c 



3 (D 




0 CO 








to E 




0 — 






C 00 




/It 










LO 




CM 


to 




c 








0 




CO 


0 


<u a; 


in 


0 > 




r3 




4J +J 




C CJ 


>5 


C)-<V 


Co 










XD 0 




Q. 




O) 




-P CO 


0 




0 — ■ 


x: 





-J 4 .c =5 o — I 



to 



ID 

cr 



o 

00 
o 

OL. 

oc 

ZD 

OL. 



ERIC 



c 











3 




c 




XJ 


XJ 


•f— 






<D 


E 


« 


00 


00 


s- 


CO 


s- 


3 


a; 


4-> 


o 




4-> 


• c 


4-> 




a; 


00 <D 


3 


& 




t- x> 


4-> 


(0 




3 3 






o 


U 4-> 


4-> 


<D 




U CO 


c 


c 




O <^ 


QJ 


Q 






X> 


c 


Q) 


4-> (/) 


3 




-C 


•1- rO 


4-> 


4- 


a 




00 


»—* 


(0 


>> c 






Q) 


»— O 


M- 




4-> 


4-> 


o 






C 4-> 








Q) 


o 


4-> 


3 q; 


{/) 




•r- 


cr 3 


3 






q; cr 
















U 




u 


•r- 




Q) 




1^ 


. jc 


sz 


SZ 




O 


4-> 


u 





C5 




>( 00 

M- O 

<D O 4-> O 

3 4-> • 

<D 4-> 

CO C/> C 

, E 3 O 

03 O E 

cn o •^'^ 
O t/> CO O 

■ >> 4-> r— 

•I- (D ^ I— 

Q; > X3 -U C5 
E <0 3 (D 2: 

o o 4-> JC 

CO JC (/> u ^ 



to 
to 

■a 05 







* 






to 


1 ^ ' rt 1 (t 

-r— ' \U 






r— O 




t 


CO Cl 


• 




E 




U 


:5 O OJ 




CD 


U .Q 






4-> > S 






fO t/> 13 










C 






CD 


as 4-> 




TU 


4_> to 




13 


-C (U 




+-> 1 — 


X) 


CO 


C Of— 


CU 




O ro 


+-> 


+-> 


S E 


CU 


CO 


OJ CO 








Ol 




to E CD 


E 


o 




O 






U 





a. 



I. 

c 
o 
u 



CU 

E 



o 
< 

Cl 



CO 




O 




>» 




+-> 


+-> 




c 






CU 


> 




•o 


•r* ' 




13 


4-> 


en 


+-> 


O 


CO 


to 


(O 




CU 


+-> 








03 


CU 






•o 


o 


CU 


5Z 


to 


> 


CU 




03 


Q. 






CU 




c 






03 








•r— 




^- 






o 




















•o 




4-> 


OJ 




03 


E 


o 




3 


o 


3: 


CO 





SZ Ui 
-M C 
•r— 

M~ O 



O O 
5Z C 

O 
V 



CU 



It 



i1 «2 
?2 CO 



o 

c E 

S- 

c o 

4-> CD 

to j:r 
c 

CD 

CU 

JZ 3 

o cr 
CD 
CU -o 

4-> 









CU 


4-> 




+-> 


SZ 




u 




CO 


CU 


•r— 


CO 


Q. E 


+-> CU 


X 




c 




CO 


CU C7> 




CO 


4-> O 


CU 




to 


r" 




•r a. 






to 

c ^ 


to 




o ta 


*t— 




U 4-> 






CU 


4-> 


u 


>^ CU 




•r— 


C SZ 






03 to 









CU . 
to 



SZ 


O 


ID 


wo: 




4-> 


+-> 






c 


CU 








o 


r* 










MO 


to 






E 


GJ 


to 


<u 








03 


C7> O 


to 




+-> 


05 






a. 






CO 


O 




*03 


CU 




+-> 






> 


00 






to 




ta 


ed 


cr> 


03 


c 




+-> 


<U 


1 


03 


c 

•r— 


ec 


1 


1 


CO 




D. 




to 


c 


CU 


X 










CU 4-> 


u 




c 






CU 




03 


CU 


c 


SZ 


Q 




jQ 


3 


u 



Cl. 



C7> 






C 






•r- 




c 






CU 1 


O 




C) X3 


+-> • 




3^ (U 


•r- 




+-> (U 


C 




CU tf- 


o 






E 










CU 03 


O 




to 






to >j 
rtJ 4-> 


cu 










4 > 






CU T- 






E -M 


CU 




•r- U 






+-> 


o 










j:: -m 


a. 




u c 
:3 (U 


<j 




E "O 








+-> 




3 4-> +-> 


OJ 




O to C 


E c^- 


< 


j:: CU 


CU to 






-»-> to 






to CU 




<U 4-> 






CD to to 


to a> 




03 4-> 


o 




S- to CU 


03 




CU CU x: 


Q. 




> 4-) 4-> 


CU 




03 


+-> 




>» o 


CU c 




CU 4-> 


SZ CU 


o 


j:: CU 


4-> "O 






13 




to u 


to +-> 




C 03 03 


t to/ 




O E JD^ 




C3 







o 


CU 


If- 


SZ 






E 




CU 






c 


to 






CO 


O ^ 




o 2: 


03 


j:z- — ' 




to 


CU 






cu.E 


cu 


03 


SZ 


jQ 








0 0 


CO 




»— < 


4-> CL 



177 



=J o 









CD 




> o 






S- 






























00 




00 










Q) C 






> 




r— 






•r— 




+-> 






+-> 




•r- O 






(J 




\ — x: 






CU 




+-> 






•r-> 














-C c 






o 




















< 




o o 










to 










:3 




















to (u 










3 to 










o 






Q) 




















+-> 




> 










•1- o 
















O 




















c 










o 




+-> 










o <^ 






+3 














Q) d) 


E 




o 




j:: 


<d 




Q. 




4-> . 


S- 








C 


a> 




+-> 




O 


o 




<d 






S- 








< +J 


Q. 














-o 










(1) 








o 










V? 












CO 






^- 




o 






) — ( 








t 

rs 








>> 


(J 






'''-^ c 






-p 




Jli o 


+-> 


il 


Q. 




O -r- 


U 




QJ 










U 






S- 


o 


U 




OO =5 


• r- 




ft? 




3 r— 


XJ 


O) 






fO 




j:: 


to 




OO > 


+-> 


+-> 


•r— 






o 










c 


o 


-p 








+-> 




CD 


-C o 


CD 




oo O 


u ^ 


S- 


"O 






00 




<D 






00 




+-> 






>> OJ 4-> 


fO 




(1) 


C > 


(0 




E 


r— 




<U 






2: 


+-> 









o 



' o 



178 



COMPENSATORY EDUCATION STUDY 
' NIE ■ 



SURVEY CONDUCTED BY: 
EDUCATI Off TURNKEY SYSTEMS, INC. 



QUESTIONNAIRE FOR : ' 
PRINCIPAL 
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COMPENSATORY EDUCATION 
PRINCIPAL'S QUESTIONNAIRE 

A. STAFF CHARACTERISTICS 

1. .Have you ever taught reading at any level in a school setting 

(self-contained elementary classroom, adult basic education, 
etc.)? • . 

[ ] YES . • . . . • _ ' \ 

M '] NO 
Mathematics? 

[ ] YES ■ 

[ ] NO ^ 

2. Are you teaching reading part-time. now in your school? 
* '[ ] YES ' . ' 

[■ ]- NO 

Mathematics? 
[ ] YES ^ 
[ ] NO 

3. Including this year, how many total years of school administrative 
experi'^nce do you have? ' 

years. 
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B. ORGANIZATION AND MANAGEMENT blT PROGRAM 

h Including this 'year, for how long have Title 1 compensatory 
education activities operated in this. school? " 
years. • . . > 

2. Do any other compensatory education programs (e.g."",' Head Startv 
State Funded Compensatory Education Programs Title 3) operated in 

, this school? , ^ ' , ' - ' * 

[ •] YES ' ^ , ' ' 

I ] NO . . , ' 

For hov/ Jong have they operated in thi§ school? 
Head Start years. 

State Funded Compensatory Education Program 'years,' 

Tif To w ' ' 

^ '_ yea I :> . 

other years. ' " • 

3. Over the past 12 months, how many times has . (Name) your 
district's compensatory education director, discussed the reading 
or mathematics activities of your compensatory education students 
with you? 

, times over past 12 months. 



erJc 
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4. What is your highest degree level held? 
[ ] - NONE 
[ ] ASSOCIATE 
[ ] BACHELORS 

/ • 
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What percent of these discussions were initiated by ( Name ). 

. % . 

What was the major topic of these discussions? 
Testing 

Student Placement 
Student Progress 

Program Moni toring (i .e. , management in general) 
Staff Considerations - • * * 

Counselling/Discipl ine/Crisis Intenvention 
Combinations of the Above 

Other (specify): ' ' 



Over this, same 12 month span, h ow many times has ( Name ) 

visited your^school to observe the readina or mathematics activities 
of this schools compensatory education stucTents? * . 
' times over the last 12 months ' 



After the typical such visit, 411 re'feeivi any feedback from^' 
(Name ) ? 

[ ] YES 
[. ] N.0 ■ 

If YES, please describe what wa^ typically said or done: 



/ 
/ 



8. How strongly does your own teachi ng .staff (including regiilar classroom 
teachers and any special compensator^ education instructors) support 
your school's compensatory education mattiematics and reading activities 
'[ this year? , ' * ^ 

t ] O^^erv/helmingly * ' 

[ ] Very strong.Ty.^ * 

i ] Strongly*^ 

[ J Somewhat strongly 

[ ] Somev/hat weakly * • ^ , 

Please describe the experiences upon which you based your response: 



USING A SCALE OF 1 to 5,- WHERE 1 MEANS "NOT INVOLVED AT aU-'AND 
5-MEANS "HEAVIUY INVOLVED" ,' PLEASE RESPOND, TO THE FOLLOWING FOUR 
QUESTIONS (NUMBERS 9 THROUGH 12/). 



9. To what degree have your specially-hired compensatory education 




VI. How about your paraprofes^sionals? 



If 



Orgamzirig the classroom (staff/ 
student relationship) for in- 
structional activities*. 
Reviewing and selecting materials 
. us^d in comp ed Instructional 
.activities. 

Reviewing and selecting or 
developing performance ob- 
jectives.. ^ 

12. How about yourself? 

J Organizing the glassroom (staff/ 
student relationship) for in- 
structional Activities, 
Reviewing and selecting materials 
used in comp ed instructional 

. activities. 

Reviewing and selecting or 
developing performance ob- 
jectives. 



Degree of Involvement ' 
Reading Mathematics 



Degree of Involv ement 
Reading * Mathematics 
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Degree of Involvement 
Reading Mathematics 

Organizing the classroom (staff/ 
student relationshipr) fo-r in- 
structional activities. ^ 

Reviewing and selecting materials 

used in comp ed activities. 

Reviev/ing and select i'ng or 
developing performance ob- 
jectives. 

Hov/ about your regular classroom teachers? « , 

V Degree of Involvement 

Reading Ma th ema tics 

Organizing the classroom (staff/ 

student. rela.tionship) for instruc- . - 

tional activities. . 

'Reviewing ^nd selecting materials 

used in instructional comp ed - t 

cictivities. 

Reviewing and selecting or ' " 

develaping performance , . ^ ' 

objecti ves> • 



Have other staff members, not covered in questions 8 through 11 
a,bove, been involved in -these three activities? 

[ ]• YES ■ ' . ■ 

[ ] NO ■ 
If YES_^please specify the staff members ^by role (e.g. , speech, 
therapist, reading consultant), whether the. area of involvemeot 
is reading or math, and the degree of involvement -- using the 
same response scale you used for question 8 through 11. ^ 

ROLE: ' L___ 

[ ] Reading [ ] Reading [ "[Reading 

[ ] Math [ ]Math [ ]Math 

Degree of Involvement \ 
r 

Organizing the classroom {itaff/ 

'* 

student relationship) for instruc- 

Reviewing and selecting materials 
used in comp ed instructional 
activities. 

Reviewing and selecting or 
developing performance 
objectives, 
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14. Which of the Tol lowing methods of toordination best describes the 
primary manner in which regular classroom teachers in this 6cho6j 
coordinate their own reading and mathematics for cprfipensatory 
.education students with the activities conducted/by special compensa- 
tory, education reading and mathematics instructors this year?- ' 
] Very little coordination. 
J Regularly scheduled staff meetings/reports . 
] Specially scheduled meetings/reports between" specific teachers. 
] Infor^nal , unscheduled communications between speci/ic teachers. 
] Other (describe) ' * 



V 

15. Overall, how satisfied are you with tfte degree of this coordination? 
] Extremely satisfied. 
] Satisfied. 
J Somewhat satisfied. 
] \Somewhat dissatisfied. 
] Very dissatisfied. 
Please describe the experiences upon which you based your response: 



Hov; would you improve this coordination? 
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16. H ow many times this year'have you met with the parents (parent) of 

any of your school's compensatory education students. to discuss reading 

or mathematics activities of that student? ' • 

times ■ ■ • . 



17. Do you maRe home visits for the purpose :(yf such discussions? 



( 

18. What 
' ' [ 
[ 



YES • ■ . , 

NO . • . 

* 

.vas the major topic of these discussions? 
Progress 
Attendance 
Discipline * 
other (specify) " ' 
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C. ORGA"f}'IZATION AND MANAGEMENT OF 
CLASSROOM READING ACTIVITIES 



THERE ARE NO QUESTIONS ON THIS TOPIC AT THIS TI>1E. 



( 



■ - n - 
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D,. METHOD OF INSTRUCTrON ', 

What method or methods of instruction have been most successfiTr 
with compensatory, education students in, your school? 
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E. STAFF DEVELOPMENT SPECIFICALLY RELATED TO 
COMPENSATORY EDUCATION READING ACTIVITIES 



How many days of teacher training (e.g., in-service) will be J 
provided to the staff of your school during 1976-77? 
days . : ' 

How many days of teacher training related to compensatory education 

reading -and mathematics activities will be provided to the staff 

of your school during T976-1977?( Include days to regular teaching 

staff when comp ed st|iff was not present plus days to comp ed 

staff where regular staff was not present plus days when both present.) 

^days for reading ^days for math / total days 

How many such days of trainingwere provided at the outset of the 
compensatory education reading program currently operating in 
your school? 

days for reading ^days for math - total days 

For hQw rrinj^ of the teacher training days will you be involved in 
this training? 

^days, general teacher training days 76-77 comp ed 

training 

days, program outset training 
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5- Which one of the following topics was most heavily emphasized during 

training periods devoted to compensatory education? 

1975-77 Program 
Training Outset- 

[ ] [ ] General instructional techniques for disadvantaged 

children. 

[ ] [ ] How to utilize paraprofessionals. 

' [ ] , [ ] Implementing individualized^ instructional activities 

[ ] [ - ] Specific techniques for teaching -reading. 

[ ] [ ] Specific techniques for teaching mathematics. 

[ ] [ ] Developing performance objectives. 

[ ] [ ] Classroom management. 

[ ] [ ] Use of student rewards for reinforcement of 

[ ] [ ] . student behavior or academic progress. 

[ ] [ ] Crisis intervention. 

[ ] [ ] other (specify) 1976-77 7 

, ■ Outset 

6. For hov/ many of these same training days was (flame) involved 

in the training? 

: ^^ays, 76-77 comp ed tra'ining ^days, program outset training 
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Which one of the following statements best describes the training 
requirements for the paraprofessionals used in your school's 
compensatory educatioji activities this year? 
In Reading In Math . 

f J f 1 They are given no formal training but are given on- 

the-job training. 

f ^ f ^ They are given a general orientation but no specific 

training. 

^ f ^ They are given specific training in certain 

specialized "areas. 
^ ^ f ^ They are given continual in-service training. 

^ ^ f ^ They must h^ve completed (or at least be attending) 

a course program for paraprofessionals. 

How many rlay^ of t-raininn y-r.l-.fo^ +^ — .„„-,4.. , r i ^ • • ■ • - 

— ""-^ ~ - ■ - s i^.ou^vj v,uiii(jciisa tui y euuCdLiori i nscructiona i 

activities will be provided to your school's paraprofessionals in 1976-77? 
days for reading day for math total days 

How many s uch days of training were provided at the outset of the 
compensatory education program currently operating in your school? 
days for reading J days for math total days 

How many of these paraprofessinn^l training days will you be involved 
in the training? , ^ 
_ ^days 76-77 comp ed days program outset 
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Which one of the following topics was most heavily emphasized during 

each of these training periods? 

1976-77 Program 
Training Outset 

[ ] [ ] General instructional techniques for disadvantaged 

t 

children. 

[ ] [ ] How to develop instructional materials. 
[' ] [' ] Implementing individualized instructional activities, 
f 1 [ ] Specific techniques for teaching reading, 
f 1 f .] Specific techniques for teaching mathematics.' 
i ] i ] Developing performance objectives . 
I ] [ ] Classroom management. 
• f 1 • [ ] .Use of student rewards for reinforcement of student 
behavior or academic progress. 
[ • ] [ •] Crisis intervention. 

[ ]' [ ] Other (specify) 1976-i77 " 

Outset 

For how many of these same paraprofessional training days was (.Name) 
involved in the training? 

days 76-77 comp ed days program outset 
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F. STUDENT VARIABLES 



Approximately what percent of your sdhooT's current compensatory 

education students started in your sfchpol at the beginning of the 

/ I 

current school year? (An estimate tp the neares-t' 5 to 10 percent would be 
sufficient unless you happen to kno^ off-hand a more precise 
estimate.) 



Approximately what percent of your 
students are absent from school on 
for indication of desired precision 



school's compensatory education 
any given day? (See question 1 

) ■ 



Approximately what percent of all the students in your school are 
eligible for the free lunch program in your district? (See. Question 
1 for indication of desired precision.) 



4. What percent of the compensatory education students in your school 
this year do you realistically expect to complete high school? 


5. "If kids currently served by compensatory education programs were performing 
up to expectations in math and reading achievement, there would be no need 
for compensatory education math and reading programs." Accepting the 
premise of this quote, what would you describe as being the causes of ' 
their performance level? 
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G. SCHOOL AND DISTRICT VARIABLES 

How many parents attend a typical PTA meeting for your school? 
parents 

What percentage of the total parents does this level 'of attendance 
represent? ~~ 

' . % 

« 

V. 

Generally, how would you describe the morale of teachers in your school? 
[ ) Extremely high 
[ '] High ^ 

[] Fairly high ^ ^ >*■ 

[ ] Average 

[ ] Rather low 

Why do you thirric this is so? 



Are you satisfied with the method used in your school for making decisions 
on curricular matters involving compensatory programs? 

[ ] YES : ' . 

[ ] NO ' . ' 

Please describe the experiences upon which you based your response; 



IS * 
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H. UTILIZATION OF STAFf -TIM E 

3 • ~ ; - 

1. On $ normal day, how many hours do the teachers » of your school spend 
working at school? 

hours ~- * 



2.. Is_ this time determined contractually? • • . 

-[ 3 YES ■ . • • • ' 

[, ] NO i 

3. Similarly, how many hours do you spend working at school on a normal day? 

- hours 

4. Determined contractually? ^ , . • 
[ ] YES 

I ] NO- • 

5. What about the length of the working day for your school's paraprofess iortals? 
. hours 

f 

6s Determined contractually? ' ' ; 

[ ■] YES ' 

[ ] NO ' • ' . J ■ 

7. And the length of the working day for any reading or mathematics specialists j' 
or consultants assigned to your school (but not paid from comp ed funds)?, 
hours 
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Is this time determined'Contractually? 
[■ ] YES 

[ ] NO. ' - " - 

What is the average number' of hours per week you. spend on coffipensatory 
education reading or mathematics activites this year outside of regular 
working hours? 
hours/week 

How have your regular working hours this year been divided among the /, 
following activities?^ 

% Of -job Time Activity ' • ^ ' 

Planning for compensatory education reading or math activities. 

Planning for all other instructional activities. \ 

i 

_^ Receiving or conducting training for comp ed reacfjng or 

iiiu oil t I V I 1 1 CO . ^ , 

Receiving or conducting training for all o'ther ' - ' 

instructional activities . 

Participating in decisions- (e.g.., selection of materials ^ 

and/t)r tests, determining who is to conduct training, 
determining performance objectives, determining evaluation " 
designs) related to comp ed reading or math activities. 

' Participating in decisions related to all other instructional 

activities.. 

General administrative activites for compensatory education 

reading or math activities. 

All other gener'al administrative activities. 

All other activities (list) 
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IK i^ow many days of student attendance are irltended^ for the ^/976-77 
^ school year at your school? * ' ' * 
. days 



12- How many additional days beyond those of student attendance are included 
in the typical teacher's working agreement at your school during 1976-77? 
l1 addttional days beyond student attendance days 

13- How many such additional days beyond student attendance dciy§ are included 
iTT^our own working agreement during 1976-77? 

additional' days beyofid student attendance days 

14 • What about the number of such additional days in' the working agreement 
or understanding of your sohoors paraprofessionals? 
additional days beyond student 'attendance days 

15* And what about the nJmber of such additional days in the working agrppmr^nt 
of anyj:gading^or mathematics specialist or consultant assigned to your 
school (but niot paid from comp ed funds)?. 
' additional days beyond student attendance days 

15* Not counting their time for lunch, how many hours are your school's 
students at school on a typical day? 
hours 
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I. MISCELLANEOUS CHARACTERISTICS 
JHE INFORMATION REQUESTED IN' THIS SECTION MAY HAVE BEEN PROVIDED BY 
YOU AT AN EARLIER TIME; PLEASE EXAMINE THE ITEM INCLUDED HERE TO VERIFY 
THAT IS. THE CASE. IF YOU- HAVE NOT ALREADY SENT THESE DATA IN, PLEASE 
PROVIDE THE DATA COLLECTOR WITH THE REqIjESTED INFORMATION AT SOME TIME 
''DURING THE SITE VISIT. 



Please provide the- fo-llowing information for the current school ,year. 

1976-77' 



GRADE 



Kindergarten 
1 

2 , • 

3 

4 

5 ^■ 
6 



TOTAL 



TOTAL 
COMP ED 



NUMBER OF 
REGULAR 
CLASSROOM 



ENROLLMENT STUDENTS TEACHERS 



number of 
regul;\r 
classroom 
teachers with 

COMP ED 
STUDENTS IN 
CLASSES 



TOTAL K-6 



t 
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2. How many compensatory education instructors and paraprofessionals served 
your students this year? Ple/se give your response in terms of both 
•the number of persons and (he fulL-time-equivalent (FTE) positions, i.e., 
2 half-time per-sons are equivalent to 1.0 FTE. 

1976-77 . ^ , • 



GRADE 
K 
1 
2 

3 ■ 
4 
5 
6 



NO. COMP ED, 
INSTRUCTORS 

4- 



TOTAL (Kt6) 



FTE COMP ED 
INSTRUCTORS 



NO. COMP ED 
PARAPROFESSIONALS 



FTE COMP ED 
PARAPROFESSIONALS 



3. In the- table below, indicate the number of parents or other community 
people who have assisted or worked with your teachers- (without pay) 

1 ' 

in the conduct of your=- school's compensatory education reading or 
mathematics a(|tivities this year. Also, please indicate the averge number 
. • of hours of sufch voluntary service provided by the typical parent and 
other communitl person this year. 
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Parent 

Studen't Teacher • * 

Student Volunteer (from 
other schools) 

Member of. Volunteer 
Organization ^'non-student) 

Member of Servide Club 
Other 
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IDENTIFICATION IXFOR'.IMION 

•Site Code (See Data Site Infomatiori Sheet) , 

■Building Code (See Data Site JnJFon^t'iih Sheet) 
' District Coap Ed Director " . n 
BuiJdin^I ■ , . I 

Building 2 ' • "2 



Range ' 

4101-7399 
0,1,2 



Codc^Data 
Count\" 



District 



00-99 
000-999 



I'ullding. 



000-999 



Interviov;oe Godo 

District Comp Ed Director 
•Principal 

Teacher of Conip Ed Students 
Special Coinp Ed Teacher 
Regular Classroom Teacher 

Paraprofessiohals 

Other St^ff 



• 10 
20 

,.30-39 
40.-49 
50-59 
60-69 



10-69 



.Other Position (s) Held: 

First -(see previous coding) 



10-69 



Second (see 




US' codijig) 
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DATA COLLECTOR'S MANUAL 

NATIONAL- INSTITUTE OF EDUCATION 
INDIVIDUALIZED INSTRUCTION STUDY 
1976-77 
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I. GENERAL INFORMATION 

Purpose of 'the Study 

This study is funded by the NationcLl Institute of Education (NIE) for 
the purpose of comparing the effectiveness of standardized compensatory edu- 
cation programs with individualized compensatory education programs. The 

compensatory educatipn programs included in the study will be^both reading 

if 

and mathematics programs, and all have been appraised as "well -implemented" 
and, hence, comparable programs. The focus of the study' ison comparing 
the effects of individualized programs versus these for standardized pro- 
grams, and not on accumulating ^descriptive data regarding the variety of 
other dimensions along which individualized programs may vary from stan- 
dardized programs. The effectiveness of both types of programs will be 
assessed by measures of reading and indtheiudLicb dchievemeni (standardized 
tests) and by their broader effects on classroom environment. Thus,^ in ad- 
dition to student testing, the study wil'l employ in-depth observations of 
programs and interviews with school staff {i,.e., principals, teachers, and 
paraprofessional s) to further amplify the student test data. 

The concept of individualization of eduijation has^ become one of con- 
siderable interest and inquiry not only among education researchers a'nd 
practitioners but also among public policy makers and members of Congress. 
Section 821 (a) of Public Law 93-380, for example, mandates NIE^ to under- 
take an analysis of the effectiveness of educational methods and procedures, 
incluciing the use of individual written educational pl^ans for children. 
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A variety of^ questions have arisen under the general issue of the effec- 
tiveness of individuali-zed in5truction: 

• How effective are well-impfl^mented individualized 
.'instructiori programs in raising achievement in 

* reading ''and mathematics for disadvantaged" children? 

• What*'is the impact; and interrelationship among other 
effects created in the class.rooni and'schooJ environ- 

* ^ me^t that can be attributed to, the effecftive impTe- * ' * *" 
^ ^ ' -in^n^atjon of, individualized instruction? 

I ' * 

e ; To what extent do locaJ education agencies (LEA's) 
. \ utilizing well -implemented individualized programs 

'of instructlon^meet the specific needs of individ- 
ual students? * , , ^ 

thus, the intent of this study 'is to provide informa-tion to answer some 
of ^these underlying issues through its comparative, evaluation of standard- 
ized and ifidivi dualized compensatory education programs in reading and 
mathematics.^* ^ * ' • 

The Rale of the Datg Collector * . ^ ' ' *" 

^1. The^ Data^col lector^s task responsibilities are identified -and descr ibed 
in subsequent sections of this manual. Ihe larger role of the data collector, 
however, should be kept in mind while discharging ttiese task responsibilities. 
The data collector will be the- primary individual involved in this study with 
whom local school personnel (principals, teachers, paraprofessional s, 'com- ' 
pensatory education coordinators, etc.) and members of . the community have 
fac6-to-face .cofitac't. Thus, to these people he is the visible representa- 
tive not only of'^he firm which has been contracted to conduct this study but 
*also of the National Institute of Education, which has requested the evalua- 
tion study. \, ' ' . 
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2. The data collector should realize that local attitudes toward the 
study (and^ >ndirectly toward the implementation contractor and NIE) will; 
^be a reflection, of his dealings with community representatives. Thus, the 
data collector should take care to conduct his responsibilities in an un- 
.obtrusive manner "and in such a way as to minimize conflict with local school 
personnel and procedures. At the same time, he/she should be responsive to 
local "community and school questions about the study and shoufd be sufficiently 
informed^about the ^tudy s purpose and rfiethodology to provide accurate and 
straightforv/ard answers (Questions beyond the scope .of the data collector's 
knowledge should be referred to the Regional Coordinator or''Data Collection 
Manager). In addition, the data collector should emphasize his/her role in 
the study as being one of - an unbiased investigator.* 



^11... DATA' COLLECTION PROTOCOL. - 

Local School and LEA' Contacts 
h It is important to remember that* many schools ahd local education 
agencies are very -sensitive to inquiry or intrusion by outsiders. They 
may have participated in or been subjected to considerable examination and 
evaluation in the past, onithey may_|jinp-ly be concerned about the role of 
NIE in evaluating programs which are jn larg^e part locally-developed and 
locally funded. Thus, data collectors should adhere to the .protocol de- 
scribed below so that schOol-s a^nd IW% are fully -informed and prepared for 
each phase aYid undertaking of the sludy. 

2. The primary and initial contact j?erson for data collec-tprs will be 
the local education agepcy's director ar coodinator of Federal or Title I 
programs . (The i ndi viiiuaTs title^^y vary.) This, individual will already 
be somewhat familiar ^wxh the Itudy and with the schools which will be par- 
ticipating in the s'tiidy. ' He' will have been given the name of the data col- 
lector for his area by threyData Collection Manager. The first task of the 
data collector should be to telephone this j'ndi vidual so that the data col- 
lector can introduce him/herself and briefly review the study plans and 
procedures, r * ' • ' - ' 

3. " The initial contacts with the s.chool principals also have been made 
by the Data Collection Manager. Each principal has been informed of his/he 
school's selection for the study and has been gjven the name of the data 
collector who will be responsible for that school ♦ After contacting the 
Federal program coordinator", the data collector will contact by telephone 
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the principals of all of the schools to be Included in the study in his/ber 
district. The purpose of this call will be for the data collector to intro 
tluce him/herslef to the principal, to initiate communi<:ations before the / 
onset of ttie school year, and to schedule a brief visit with each; principal 
It is- important that this initia.1 contact, like all subsequent contacts, 
should establish an atmosphere of open communication and should evidence $n 
appreciation of th^ ^^a^ikr.tcKday demands and concerns of school personnel.- 
The first meeting with the principal should' be scheduled well in advance 
of the beginning of school activities in August in order to avoid unduly 
complicating the principal's schedule. This visit will enable the data 
collector to fami liarize- him/hersel f with the schools, the programs operat- 
ing in the district, .and the names and number staff persons involved. It 
will enable the principals to become more familiar with the study and its 
conduct. This brief initial meeting should include a discussion of the 
following elements'of the study:' 

§ the classrooms and staff members involved; 

t determination of schedule and an appropriate location 
. or initial staff interviews (principals, teachers, and ^ 
teacher's aides); 

- § determination of schedule for administering pre-tests 
for achievement and affective capabilities; and . 

t determination of the most appropriate time and ap- 
• proacti for the data collector to introduce him/herself 
to the* teachers involved in order to expl^in^^the study 
more thoroughly. This orientation meeting with teachers 
must be scheduled before school starts, preferably dur- 

' , iT)g the districi's teacher orientation week. 
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A teacher on'entatton visit should be scheduled in order to: 

* . • fully explain the study to the teachers whose classrooms 
are involved; ■ . 

outline what specifically will be involved in tertns of 
interviews and testing; and 

respond to teachers' concerns, and - ' - 

describe the role, of the data collector in the stud^ -X 
In addition, and most important, the data collector should confirm the" \ 
tentative schedules, and appropriate locations for interviewing and test 
administration which were previously discussed with the principal . If an 
empty classroom 'or office or a saitab-le area in the teache/s' lounge is 
not available for use in all 'interviews, then the data collector must not 
only establish a time but also determine an appropriate location for each, 
interview; and make sure that both the time and the location are acceptable 
to the teacher. If time permits, it may be possibleto conduct soJe of the- 
staff interviews during- orientation week. During the orientation visit, it 
may be necessary for the data collector to emphasize the procedures for 
data confidentiality which will be. operative during the study, and to ind>-" 
cate the data collector's appreciation of the need to minimize classroom , 
disruptions. The approach of the orientation visit may be 'to meet with the 
teachers either as a grouper fndividually. depending on the"time constraints and 
preferences of thp data col lector. the principal, ?nd the teachers themselves,^ 

5. -Staff interviews represent the first data collection takk of the study. ' 
Staff interviews can be conducted as part of .the teacher orientation visit, - 
if meetings are individually scheduled.' Otherwise, the,<interview schedule 
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should have been confirmed during the ^teacher orientation. visit, and 
should be completed by the end of the first four weeks of the 1976-77 
school year. When interviews are held While s(|hool is in session, it is 
important that the interview times be scheduled about a week in advance— 
at a minimum, two days in advance. It is important to recognize that the 
individuals to be involved In these interviews have substantial constraints 
upon the time they have available for participation. . Teachers,' for example, 
will probably have only one "free" period during which the interview can 
be conducted and may or may not easily have access to an appropriate inter- ■ 
view location. .This, is the rationale for establishing an appropriate loca- 
tion for interviews before the interview time, so that time is not spent 
searching for a location. It is important that data collectors recognize 
the need not only to conduct the interview efficiently but also to be re- 
sponsive to the teachers- concerns regarding the study. During the inter- 
view sessipn, therefore, the data collector should review briefly the pro-' 
cedures for data conf identlalty and for administering the tests. The test' 
administration guides can be j-eviewed, and a tentative schedule for admin- 
-istering the test can be established with each teacher iri,dividuall-y. (How- 
ever, 5ince the tests will be administered on. the same day, if possible; a 
final schedule should.be developed after the interview and sent to all in- • 
volved teachers.) Also during the teachers' jinterviews, ar\ appropriate time 
for scheduling interviews with each teacher's! aide(s) should be determined. 

Interviews with principals may be easier to schedulq, since principals 
have greater control over their time thsn teachers . However, the data col^ ' 
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lector should recognize that principals may have more interruptions during 
the interview session. Therefore, the interview should^ be ^5cbedule.d for 
a.t least one hour's duration. .Again, the data collector should take care 
to be responsive to the principal's concerns and/or desires for additional 
information regarding s4udy procedures.' 

Although appropriate times for interviewing the teacher's ai-des should 
have already been established during the teachers' interviews, it is impor- 
tant to confirm that time with each teacher aide as soon as possible, per- 
haps at the end of each day's teacher interviews. Again, an open and infor- 
mative atmosphere should prevail during the aides' interviews. 

6. • Teachers' questions' regarding the administration of the pre- and post- 
tests should be answered through a review and discussion of the test admin- 
'fstration guides during the initial interview. 

7. Many teachers find classroom visiters pr observors disruptive of 
normal .classroom routines. Certainly, the presence of the data collector 
in the cjassroom may introduce a certain atmosphere of artificiality, but 
disruption can be kept to ^a minimum^ by the use of the following procedures: 

s-cheduling the visit approximately two days in advance; 

ioforming the 'teacher about the nature of the classroom ob- 
servation process; 

arriving at the classroom promptly at the appointed time; and ■- 
* 

being responsive to the te'acher.'s wishes regarding classroom 
procedures during the observation, period. 
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Local Community Contacts 

1. In some schoc] districts, the .data collector may be requested or re- 
. quired to have cor\|aGts with local community groups (e.g., civic assbcia- 

PTA's, etc.) regarding the study. The purposes of • " 
undoubtedly be diverse, but some local concerns can be 



tions, school boarc 
•these contacts wi/Il 
anticipated: 



What is 



the purpose of this study? 



Why is 'our" program being evaluated since i^t has already 
been evaluated before? • dH.eaay 



e 



Who will get the information about our schools'-and children?' 
Will this, study interfere with normal .classroom procedures? 
In order to answer these other questions it is important that data col- 
lectors be familiar with the' overal 1 objectives 'and design of the study 

(see Section I of fhi^ jD^mi^}) anw-i.,T+u . ^ ^ , , 

i^..^a./ ^..j^Mjui, cue uk,euur'eb tor selecting par-' 

^ticipating school districts. Data 'col lectors should thoroughly familiarize 
themselves with the overall- design and intent of the study because- any in- 
ability to be straightfornvard and informative on their part may be inter- 
preted as evasiveness or uncgoperativeness by local groups arid individuals. 
The data collector's attitude during community contacts should be one of' 
providing information in an open, straigh'tforv/ard manner . • Aggressive de- 
fense of the study should not be required nor undertaken. If questions 
from local groups are beyond the data collector's scope of knowledge or 
have ramifications for the conduct of the study,' these questions should be 
, referred to the Regional Coordinator or Data Collection Manager. 
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in. administrahve procedures ^ . ■ 

. Time Allocation Log 
^' """^^ Time Allocation Log shoulV be maintained daily and submi.tted to 
the Regional Coordinator on the 15th and last days of each month. It in- 
dicates how the^a collector's time ws's- a 1 located, by t^sk, over the re- 
porting period, yrompt completion of the log is required, for effective 
project management. , • • - 

2. The procedures for completing the Time Allocation Log are as follows 

l^'fr Zlull ^o''°? ^'V^'^f^ ^^P°^"^ -^e-g-' November ' 

l-15^Apnl a5-30, etc.). Cross out the dateline which 

does^ot apply (i.e., for November 1-15, cross' out the date- 
line 16-31). Draw verti'cal lines through dates Represent- 
ing weekends. ' • . ■ ♦ 

' • • • 
Enter the number of -actual hours~ spent 'each day in perform- 
ing the five primary tasks^ i'ntervi«wi ng, testing, observa- 
tion, training, and adminis1;rati ve task's 

- -. ! • ' 

Then enter the number of hours spent in ancillary tasks in 
. support of the primary tasks. "These ancillary tasks are 
labeled: interview-miscellaneous, testing-miscellaneous, 
■and obs^rya^on-miscellaneous. They include such tasks as 
scheduling interviews , .c6di ng interview and observation 
instruments, e^istri.buting test mateV^ials, etc. . . " 

Enter the number of hours spent oh any other task not- 
covered by these categories in the "other" category ^ 
Specify what this "other" category was, e.g. .- meeting 7 
with PTA president. ^ " ^ . 

Total -the number of hours vertically by day. The total 
. hours should not exceed eight hours/dav. Then total the" 
. hours.horizontally by type of activity". Finally, total 
, the last horizontal colum.n (which should agree with the 
last vertical column) to derive the . grand to tal which - 
should appear in the block at the. bottom righthand corner 
• of the form, v 
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f. A sample of a completed Time Allocation Log follows this 
page. 

Expense Report . 

•1. • The expense report should be submitted simultaneously with the Time 
Allocation Log. It is important that it be submitted promptly not only 
for project management purposes, but also so that data collectors can be 
expeditiously reimbursed for their out-of-pocket expenses. These expenses 
should not normally be significant but may include expenses directly re- 
lated to the conduct of the data collection effort, such as: gasoline ex- 
penses for use of a private automobile, «taxicab faf^es, loc^l transportation 

expenses, or minor office supply purchases.. , ' 

» 

2., Completing this Report: The amount, date, type, and reason for ^ach 
expense item should be indicated on the expe.nse rdp(yrt. Any claim for re- 
imbursement which exceeds 525.00 should be accompanied by a receipt. 

Daily Activity Log <■ 

1. The Daily Activity Log, like the Time Allocation Log and the 'Expense 

Report, should be submitted bi-weekly. This activity fog is a record of * 

^ata collection contacts on a day-to-day basis. All information pertaining 

to schools and staff membtrs will be recorded in code on this log. It is 

impo^rtant to complete the form daily because it may be difficult to remember 

accurately the activities Of any one day after some time has elapsed! 

2'. - The procedures for completing the Daily Activity Log are as follows: 

a. ^ ^ Each day , enter the code numbers of the schools visited and 
staff members involved for each primary activity which took 
•place. 
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b. Circle the primary activi ty--interv.iew, testing, or obser- 
vation--involved in each situation/^^' 

c. Enter the date at the top. of the page. If additlghal space 
is required, use a second page,- enter the date again , and at- 
tach it to the first page. 

d. A sample of a completed Daily Activity Log follows this page. 



Confidentiality arid Coding 

1. Confidentiality of educational data--particularly student-^rel ated 
data--is a subject which has gained a great deal of attention during the 
past year. In order to protect the confidentiality of those individuals 
and schools which will participate in this study, all of the data will be 
coded bn-site tp guard against its improper use. The coding key will ,be 
developed on-site by each data- col lector. The Icey will assign a unique 
code to each school, principal, teacher, aide, and student. It will be 
kept in a secured area in the local data col lector's 'office. Only one 

- V 

copy of the koy will ,be made. This copy will be sent in a clearly labeled- 
Sealed envelope to the Project Directdr, who will maintain the keys from 
all si tes--unopened--in a secured area,, as a precaution against inadvertent 
di^truction of an on-site key. At the end of thp project, both" copies of 
all coding keys immediately wil 1 be destroyed. 

2. The'following considerations might be kept in mind when developing 

-and using the coding key: 

t It may be helpful to develop a code in which each digit or 
group of digits has some significance, rather than, for 
example, sequentially assigning a six-digit number to ea,cK . 
person involved in the study. Thus, for example, unique, 
d'igits or letters could be assigned to the various school 
bu.ildings, classrooms, or roles (teacher, aide, student, ^ 
principal) which when combined v/ould produce a unique 
identifier . 
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DASLY ACTIVSTY LOG 



name, 



1 TYPE .OF ACTIVITY: 

Locat i on : 440^ 

{School ) 



Comment? : 



.2 TYPE OF ACTIVITY: 
Locat i on : 



(School) 




Comments : 



date 



Test i ng 



Observat i on 



(Staff) 



Test i ng , Observat ion 

~^ (Staff) 



3 TYPE OF ACTIVITY: I htervi ey 

Locat ion : 

(School ) ^ 

Comments: 



k TYPE OF ACTIVITY: 



I ntervi ew 



Locat ion: 
Comments : 



TLLQ 



(School) 



Test i ng 



Observat ion 



(Staff) 



Testing ^ ^^^Obse rvat i on^ 

{Staff) ^ . ' 



? TYPE OF ACTIVITY 
Locat ion : 



I nte rv i ew 



(School) 



Comments : 



Test I ng ^^^^ervat ionT^ 

(Staff) 



6 ^TYPE OF ACTIVITY: <Tr>fe rvi ew 
Locat ion : 

(School ) 



Tes t i ng 

(Staff) 



Observat i on 



Comments : KjA^h^SU^ XaA-^Jxjj^L&A^ - > ^t*XXX J^^VJux^ 



7\n School and Staff enteries are to be denoted by numerical identifiers 
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There should be a balance between the logic and -ease of using 
• the code from the data collector's viewpoint and the ease 
of decoding th-e information by an outsider. 'For example, 
assigning students numeVic codes based on the alphabetic 
order of their last names may not serve much purpos^e in 
terms of data security. 



When including the co*py of coding key to the Project Director, 
wvite "DO NaT OPEN" in large legible print on the front' of 
the envelope. 



IV. DATA COLLECirON PROCEDURES ' 



Intervi ews - ' 

The following general procedOres apply to all interview situations: 

a. Explain that you work for the implementation contractor which 
IS under contract tp NIE. ' . 

b. _ Emphasize that you are not allowed to explain any items; 

respondents are to respond tp items to the'best of their 
ability. ' - • - ■■ ' 

c. Speci.fic instructions for each questionnaire follow this 
. ^, • ■ section on- general procedures. However, for all<jues- 

tionnaires, >ou should always fill out the lefthand side of 
of the response sheet first, either checking off answers 
o'' filling in blanks as the respondent gives you the ' * 

..information. It is extremely important for chec-kihg pur- 

• -poses that the lefthand side is comp'leted. 

- * ' ' - " 

• d. Do not code responses 'in the data fields on the fa>* right 
of the response sheets during any interview unless you 
can accomplish this task .Unobtrusively and without unduly 
' delaying thp interview process. 

e. Record the coded ID nulYiber in the ID space every shee£ 
,of every response set you use. - • 

f. . When you code the data (i.e.-, enter it on the righthand bide 
• . of the response sheet) enter data in every indicated 

(blank) coding space. The "range" column will indicate 
how many digits, are required (e.g., a-n answer of 2?o with 
a coding range of nnn-lOO, would be entered as 002). 

.g. Print as legibly as you can. Take care so that the numbers 
you code on the- f$r right on. each response sheet are clearly 
readable. Remember that it is particularly easy, to confuse 
"1" and "7" and "4" and "9" when writing is not neat. 

h. After you" finish coding, you should have no blanks on any 
of the forms except "those identified in some documents as 
being appropriate (e.g., blank's .qext to shaded items on 
response sets or blanks listed .in the coding instructions 
for cases of overlap in study personnel). 
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In Appendices A through D of this manual are t'h^ specific- instr'u- 
ments to.be used during interviews with: t 

• District Coordinator (Appendix. A) ♦ ^ ' ' . 

• Principals (Appendix B) " - . • 

• Teachers (Appendix C) - * . ' 

• ' Paraprofessionals (Appendix D) ^ " 

Observations ^ , . 

1. One aspect of -^jou^esponsibij ities as a data collector will be to 
collect data regarding the implementation of the "comprehensive educati(5;(r 
prog^ram in your school district. A data col 1 ection/observation instru- 
ment has^ been specifically designed for the. program being used in your 
district. During the training session, y6u were instructed in the use 

of this instrument. * • ■ ° . 

2. This is the only instrument you will use to record data and/or ob- 
servations regarding program implementation. As with all data collection 
instruments and' questionnaires used in this study, you should' follow in- 
structions .carefully , collect the data during the appropriate timeframe, 
and code -all data which could identify any school , student, or, school 
personnel. 

Test Administration 

1. Three types of tests will be- administered to alf students involved 
in this studyf Stanford Achievement Test (SAT), the Piers-Harris test of 
(student) self-concepts, and a test of (student) Attitudes Toward School. 

< 
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2. ' The SAT will be given twice during the school year, once at the 
'beginning of the year and again at the end. It is very likely that the 

school district will also have a standardized achievement test "which it 
Will administer to studefits for its own purposes: During your first con- 
versation with the' school principal, you should determine what the schooVs 
schedule is for administering their o^n standardized achievemeni; tests. 
If the school's testing schedule is such that fall achievement tests wilT 
be given before you are ready to administer the SAT, then it is important ,, 
that, in the spring, the school's^ test also" should 'precede the SAT for'this ' 

project. Conversely, if the school's test will occur after the SAT in the ??C 

• * , . - * — ' — ■ . -5^" 

farll, then, in th*e spring, the school test, ^1 so should occur after the SAT 

^— < ' ' ' . ' ' . 

for. this project. It is very important that the order in 'which the schqp.l 

and the project achievement tests are given is consistent from the^fall -to • 
the spring. It is also important that the achievement tests be scheduled ' 
for all cla'ssrooms on, the same day or days. 

3. -The two„other tests should.be given fairly late in the school year--. 
March or later. It is not necessary, but it may be convoni'ent to schedule 
the tests for the same day for all classrooms in, the school which are involved 
in 'the study. 

4. The classroom teachers will administer the test. Your role will be 
that of a central infori^ation source and monitor, should a need for assistance 
or information arise. All of the tests are standardized and all have manuals 
or instructions for their u$e.^ It is the responsibility of the data collector 
to be thoroughly familiar with those instructions. .Know th^m well enough so - 
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that you could administer the test if you had to. The reason your famili-. 

arity is stressed is that you must serve as the focal point for training 

the teachers in the use of the tests. ^Th1s training will be an individual 

effort, and can conveniently be incTuded as part of the teacher interviews. 

Thus, at tlie conclusion of the teacher interview, the data collector should 

review the^ procedures for conducting all three of the types ^of outcome 

measurement instrufnents. Each teacher will be provided v^ith copies of 

manuals and Mnstrijctions before the tests are conducted. 

,5. The data collector should follow the procedures outl ined, below in 

overseeing the administration of the three types of ins"truments--the SAT, 

the (student) Attitudes Toward School, and the Piers-Harris (student) , ' 

sel'^'-coneepts test: 

• • All test material'^s required for the project will be sent 

to the data rnllprtnr, Test pst'^^rials will inclu'dLv tcGchGrs' 
instruction manuals, sample tests^ student test booklets," - 
apd answer 'Shi?ets . 

« Test schedules should be agreed upon by teachers and school 
principals and established well in advance (at least two 
weeks) of actual testing day. ' ' ' - 

. e ' Jeachers instl^uction manuals a'nd sample tests- should txe - 
■proyi<ied by the data collector to all teachers for review 
•I ' sevferal days -in advance of the testing date. The actual 
student tests should be delivered 'by the data collector 
•\ to the teach&r on the day before the test is to be 

administered.^ . , . ^ 

0 The data collector s^ould be accessible to teachers at 

aopointed times for several days ^prior to testing *in order 
rb answer any questions. During>t)ie actual aflfninistra- 
tion of the tests, the data collector must also be acces- 
sible at all times--either personnally or by telephone-- 
in order to offer assistance or to .actually administer a 
test in cases of . emergency . ^ ; 
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The data collector should pick W completed tests as soon 
as the testing period is over, lie teach'er should have 
checked to make certain that al-K^udent tests were present, 
but the data collector' should confirm this', then/ the data- 
collector should affix the student c6de labels on the'tests 
so that no test can be identified by student name. All tests 
should tehn be sent to the Data Collection Manager. 
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APPENDIX A 



-DISTRICT COORDINATOR QUESTIONNAIRE 
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. EOMP£NSATORY EDUCATION STUDY 
NIE • • 



SURVEY CONDUCTED M: 
EDUCATION TURtNKEY SYStImS, INC. 



QUESTIONNAIRE FOR : " 
DISTRICT COORDINATOR 



TO BE- FINALIZED BY • - 
I MPL EMtN-TAT I ON - CONTRACTOR 
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APPENDIX B 



PI^INCIPAL QUESTIONNAIRE 



X 
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COMPENSATORY EDUCATION STUDY. 

NIE ' , ■ 



4 ■ ■ -• 



SURVEr CONDUCTED BY: 
EDUCATION T-URNKEY SYSTEMS, ■ INC, 



■QUESTIONNAIRE FOR : 
PRINCIPAL 



INCLUDED AS APPENDIX 13 
OF THIS REPORT , 




APPENDIX C 



TEACHER QUESTIONNAIRE 
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COMPENSATO^DUCATION STUDY 



V 

SURVEY CONDUCTED -BY: 
EDUCATION TURNKEY SYSTEMS, INC 



QUESTIONNAIRE FOR : 
TEACHER 



t 



TO B£ FINALIZED BY 
IMPLEMENTATION CONTRACTOR 
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APPENDIX D 



PARAPR0FESS I ONAL QUEST lONNAI RE 
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COMPENSATORY EDUCATION STUDY 
NIE 



SURVEY CONDUCTED BY: 
EDUCATION TURNKEY SYSTEMS, INC. 



QUESTIONNAIRE FOR : 
PARAPROFESSIONAL 



TO BE FINALIZED BY 
IMPLEMENTATION CONTRACTOR 
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